2024-04-20T01:59:05.007 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-20T01:59:05.008 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} --owner scheduled_yuriw@teuthology --name yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202 -- /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/orig.config.yaml 2024-04-20T01:59:05.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T01:59:05.129 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202 branch: wip-yuri7-testing-2024-04-18-1351-reef description: rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} email: yweinste@redhat.com first_in_suite: false job_id: '7664202' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri7-testing-2024-04-18-1351-reef ceph: conf: global: mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 15eecde2bab9803889d929c7e423d07970d8cbed ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 15eecde2bab9803889d929c7e423d07970d8cbed selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2024-04-18-1351-reef sha1: 15eecde2bab9803889d929c7e423d07970d8cbed owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - - osd.3 - osd.4 - osd.5 - client.0 seed: 6867 sha1: 15eecde2bab9803889d929c7e423d07970d8cbed sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri7-testing-2024-04-18-1351-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_15eecde2bab9803889d929c7e423d07970d8cbed/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 15eecde2bab9803889d929c7e423d07970d8cbed targets: smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZNIdUmQNy2P5RbxBxa/gw7UTvoWRj4MzS+oipwtFH1P9olpb1M91lDtfcqzPvPv6bE0cUy5O5lnfRuIJ3HbwE= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAD6/4gC+PW3zli9Ira+FTiwB/Njx+RA7VqNakt7qzqQGMIOg3UvWBLheHQA19HPyYcJB4hh6KJZdtZX2N2q/tc= tasks: - install: null - ceph: log-ignorelist: - missing primary copy of - objects unfound and apparently lost - had a read error - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) - \(PG_DEGRADED\) - \(OSD_TOO_MANY_REPAIRS\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - full_sequential: - exec: client.0: - sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33 - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33 - sudo ceph osd pool create test 16 16 - sudo ceph osd pool set test size 3 - sudo ceph pg dump pgs --format=json-pretty - radosbench: clients: - client.0 create_pool: false objectsize: 1048576 pool: test time: 360 type: rand - exec: client.0: - sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0 - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-20_01:10:46 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-20T01:59:05.129 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_15eecde2bab9803889d929c7e423d07970d8cbed/qa; will attempt to use it 2024-04-20T01:59:05.130 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_15eecde2bab9803889d929c7e423d07970d8cbed/qa/tasks 2024-04-20T01:59:05.130 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-20T01:59:05.132 INFO:teuthology.task.internal:Checking packages... 2024-04-20T01:59:05.157 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '15eecde2bab9803889d929c7e423d07970d8cbed' 2024-04-20T01:59:05.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T01:59:05.157 INFO:teuthology.packaging:ref: None 2024-04-20T01:59:05.158 INFO:teuthology.packaging:tag: None 2024-04-20T01:59:05.158 INFO:teuthology.packaging:branch: wip-yuri7-testing-2024-04-18-1351-reef 2024-04-20T01:59:05.158 INFO:teuthology.packaging:sha1: 15eecde2bab9803889d929c7e423d07970d8cbed 2024-04-20T01:59:05.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri7-testing-2024-04-18-1351-reef 2024-04-20T01:59:05.310 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1252.g15eecde2 2024-04-20T01:59:05.312 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-20T01:59:05.318 INFO:teuthology.task.internal:no buildpackages task found 2024-04-20T01:59:05.318 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-20T01:59:05.333 INFO:teuthology.task.internal:Saving configuration 2024-04-20T01:59:05.346 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-20T01:59:05.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T01:59:05.379 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 01:53:47.726152', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZNIdUmQNy2P5RbxBxa/gw7UTvoWRj4MzS+oipwtFH1P9olpb1M91lDtfcqzPvPv6bE0cUy5O5lnfRuIJ3HbwE='} 2024-04-20T01:59:05.403 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 01:53:47.727500', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAD6/4gC+PW3zli9Ira+FTiwB/Njx+RA7VqNakt7qzqQGMIOg3UvWBLheHQA19HPyYcJB4hh6KJZdtZX2N2q/tc='} 2024-04-20T01:59:05.403 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-20T01:59:05.409 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2024-04-20T01:59:05.409 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-04-20T01:59:05.409 INFO:teuthology.run_tasks:Running task console_log... 2024-04-20T01:59:05.484 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2ce9a0af70>, signals=[15]) 2024-04-20T01:59:05.485 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-20T01:59:05.491 INFO:teuthology.task.internal:Opening connections... 2024-04-20T01:59:05.491 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T01:59:05.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T01:59:05.570 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T01:59:05.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T01:59:05.643 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-20T01:59:05.650 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-04-20T01:59:05.671 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-04-20T01:59:05.671 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-20T01:59:05.730 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2024-04-20T01:59:05.730 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-20T01:59:05.731 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-20T01:59:05.732 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-20T01:59:05.732 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-20T01:59:05.754 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-04-20T01:59:05.776 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-04-20T01:59:05.776 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-04-20T01:59:05.835 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux" 2024-04-20T01:59:05.835 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.6 (Ootpa)" 2024-04-20T01:59:05.835 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.6" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-20T01:59:05.836 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-20T01:59:05.837 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-04-20T01:59:05.873 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-20T01:59:05.882 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-20T01:59:05.888 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-20T01:59:05.888 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-04-20T01:59:05.890 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-04-20T01:59:05.909 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-20T01:59:05.915 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-20T01:59:05.915 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-04-20T01:59:05.951 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-04-20T01:59:05.979 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-20T01:59:06.030 INFO:teuthology.run_tasks:Running task kernel... 2024-04-20T01:59:06.045 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-20T01:59:06.045 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.3': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-20T01:59:06.045 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T01:59:06.046 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T01:59:06.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T01:59:06.064 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-04-20T01:59:06.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T01:59:06.065 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-20T01:59:06.123 INFO:teuthology.orchestra.run.smithi117.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:06.123 INFO:teuthology.task.kernel:Running kernel on smithi117: 4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:06.123 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-04-20T01:59:06.125 INFO:teuthology.orchestra.run.smithi171.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:06.125 INFO:teuthology.task.kernel:Running kernel on smithi171: 4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:06.125 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-04-20T01:59:07.610 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T01:59:07.610 INFO:teuthology.orchestra.run.smithi171.stdout:Unable to read consumer identity 2024-04-20T01:59:07.647 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T01:59:07.647 INFO:teuthology.orchestra.run.smithi117.stdout:Unable to read consumer identity 2024-04-20T01:59:08.002 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:08.002 INFO:teuthology.orchestra.run.smithi117.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-20T01:59:08.002 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:08.034 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:08.034 INFO:teuthology.orchestra.run.smithi171.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-20T01:59:08.034 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:09.913 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-04-20T01:59:09.950 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2024-04-20T01:59:11.294 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-20T01:59:11.584 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2024-04-20T01:59:14.916 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 461 kB/s | 24 kB 00:00 2024-04-20T01:59:15.282 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 587 kB/s | 24 kB 00:00 2024-04-20T01:59:15.669 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-20T01:59:15.669 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-20T01:59:15.744 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T01:59:15.745 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T01:59:15.745 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T01:59:15.873 DEBUG:teuthology.orchestra.run.smithi117:> echo no | sudo yum reinstall kernel || true 2024-04-20T01:59:15.960 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-20T01:59:15.960 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-20T01:59:16.037 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T01:59:16.038 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T01:59:16.038 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T01:59:16.171 DEBUG:teuthology.orchestra.run.smithi171:> echo no | sudo yum reinstall kernel || true 2024-04-20T01:59:16.207 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T01:59:16.208 INFO:teuthology.orchestra.run.smithi117.stdout:Unable to read consumer identity 2024-04-20T01:59:16.462 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:16.463 INFO:teuthology.orchestra.run.smithi117.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-20T01:59:16.463 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:16.511 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T01:59:16.511 INFO:teuthology.orchestra.run.smithi171.stdout:Unable to read consumer identity 2024-04-20T01:59:16.740 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:16.740 INFO:teuthology.orchestra.run.smithi171.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-20T01:59:16.740 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:16.772 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:02 ago on Sat 20 Apr 2024 01:59:14 AM UTC. 2024-04-20T01:59:16.842 INFO:teuthology.orchestra.run.smithi117.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-20T01:59:16.850 INFO:teuthology.orchestra.run.smithi117.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-20T01:59:16.903 INFO:teuthology.orchestra.run.smithi117.stderr:Error: No packages marked for reinstall. 2024-04-20T01:59:16.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum reinstall -y kernel || true 2024-04-20T01:59:17.057 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:02 ago on Sat 20 Apr 2024 01:59:15 AM UTC. 2024-04-20T01:59:17.130 INFO:teuthology.orchestra.run.smithi171.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-20T01:59:17.130 INFO:teuthology.orchestra.run.smithi171.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-20T01:59:17.173 INFO:teuthology.orchestra.run.smithi171.stderr:Error: No packages marked for reinstall. 2024-04-20T01:59:17.221 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum reinstall -y kernel || true 2024-04-20T01:59:17.283 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T01:59:17.283 INFO:teuthology.orchestra.run.smithi117.stdout:Unable to read consumer identity 2024-04-20T01:59:17.499 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:17.499 INFO:teuthology.orchestra.run.smithi117.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-20T01:59:17.499 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T01:59:17.556 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T01:59:17.557 INFO:teuthology.orchestra.run.smithi171.stdout:Unable to read consumer identity 2024-04-20T01:59:17.805 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:03 ago on Sat 20 Apr 2024 01:59:14 AM UTC. 2024-04-20T01:59:17.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:17.841 INFO:teuthology.orchestra.run.smithi171.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-20T01:59:17.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T01:59:17.867 INFO:teuthology.orchestra.run.smithi117.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-20T01:59:17.867 INFO:teuthology.orchestra.run.smithi117.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-20T01:59:17.909 INFO:teuthology.orchestra.run.smithi117.stderr:Error: No packages marked for reinstall. 2024-04-20T01:59:17.955 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-04-20T01:59:18.115 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:18.115 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:18.115 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-20T01:59:18.115 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-20T01:59:18.115 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-20T01:59:18.153 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-04-20T01:59:18.154 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:03 ago on Sat 20 Apr 2024 01:59:15 AM UTC. 2024-04-20T01:59:18.165 DEBUG:teuthology.parallel:result is None 2024-04-20T01:59:18.225 INFO:teuthology.orchestra.run.smithi171.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-20T01:59:18.225 INFO:teuthology.orchestra.run.smithi171.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-20T01:59:18.255 INFO:teuthology.orchestra.run.smithi171.stderr:Error: No packages marked for reinstall. 2024-04-20T01:59:18.307 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-04-20T01:59:18.465 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:18.466 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-20T01:59:18.466 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-20T01:59:18.466 INFO:teuthology.task.kernel:Enabling kdb on osd.3... 2024-04-20T01:59:18.466 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-20T01:59:18.506 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-04-20T01:59:18.524 DEBUG:teuthology.parallel:result is None 2024-04-20T01:59:18.524 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-20T01:59:18.533 INFO:teuthology.task.internal:Creating test directory... 2024-04-20T01:59:18.533 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T01:59:18.535 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T01:59:18.581 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-20T01:59:18.599 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-20T01:59:18.643 INFO:teuthology.task.internal:Creating archive directory... 2024-04-20T01:59:18.643 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T01:59:18.646 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T01:59:18.679 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-20T01:59:18.687 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-20T01:59:18.687 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T01:59:18.719 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T01:59:18.744 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T01:59:18.755 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T01:59:18.760 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T01:59:18.770 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T01:59:18.771 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-20T01:59:18.779 INFO:teuthology.task.internal:Configuring sudo... 2024-04-20T01:59:18.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T01:59:18.798 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T01:59:18.839 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-20T01:59:18.848 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-20T01:59:18.848 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T01:59:18.865 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T01:59:18.895 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T01:59:18.969 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T01:59:19.018 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T01:59:19.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T01:59:19.142 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T01:59:19.143 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T01:59:19.208 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T01:59:19.254 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T01:59:19.307 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T01:59:19.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T01:59:19.432 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T01:59:19.433 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T01:59:19.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-04-20T01:59:19.501 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-04-20T01:59:19.563 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T01:59:19.581 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T01:59:20.065 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-20T01:59:20.072 INFO:teuthology.task.internal:Starting timer... 2024-04-20T01:59:20.073 INFO:teuthology.run_tasks:Running task pcp... 2024-04-20T01:59:20.141 INFO:teuthology.run_tasks:Running task selinux... 2024-04-20T01:59:20.195 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-20T01:59:20.196 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-04-20T01:59:20.268 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-04-20T01:59:20.270 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-04-20T01:59:20.318 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-04-20T01:59:20.320 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-20T01:59:20.320 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-04-20T01:59:20.355 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-04-20T01:59:20.355 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-04-20T01:59:20.377 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-04-20T01:59:20.377 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-04-20T01:59:20.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-20T01:59:20.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T01:59:20.423 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-20T01:59:20.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T01:59:20.450 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-20T01:59:20.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-04-20T01:59:20.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-04-20T01:59:20.518 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-20T01:59:20.528 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-20T01:59:20.544 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-20T01:59:20.545 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-20T02:09:29.176 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-04-20T02:09:29.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-20T02:09:29.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T02:09:29.263 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-20T02:09:29.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-20T02:09:29.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-20T02:09:29.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T02:09:29.408 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-20T02:09:29.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-20T02:09:29.481 INFO:teuthology.run_tasks:Running task clock... 2024-04-20T02:09:29.492 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-20T02:09:29.492 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T02:09:29.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T02:09:29.494 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T02:09:29.495 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T02:09:29.526 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T02:09:29.542 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T02:09:29.551 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T02:09:29.567 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T02:09:29.619 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-04-20T02:09:29.631 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-04-20T02:09:29.631 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-04-20T02:09:29.643 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-04-20T02:09:29.645 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T02:09:29.658 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T02:09:29.659 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T02:09:29.671 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T02:09:29.729 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2024-04-20T02:09:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T02:09:29.732 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-04-20T02:09:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.733 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.737 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found 2024-04-20T02:09:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T02:09:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-04-20T02:09:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.742 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.743 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:09:29.743 INFO:teuthology.run_tasks:Running task install... 2024-04-20T02:09:29.752 DEBUG:teuthology.task.install:project ceph 2024-04-20T02:09:29.752 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed'}} 2024-04-20T02:09:29.752 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed'} 2024-04-20T02:09:29.752 INFO:teuthology.task.install:Using flavor: default 2024-04-20T02:09:29.759 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-20T02:09:29.759 INFO:teuthology.task.install:extra packages: [] 2024-04-20T02:09:29.759 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed', 'tag': None, 'wait_for_package': False} 2024-04-20T02:09:29.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=15eecde2bab9803889d929c7e423d07970d8cbed 2024-04-20T02:09:29.762 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed', 'tag': None, 'wait_for_package': False} 2024-04-20T02:09:29.762 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=15eecde2bab9803889d929c7e423d07970d8cbed 2024-04-20T02:09:29.912 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/ 2024-04-20T02:09:29.912 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1252.g15eecde2 2024-04-20T02:09:29.984 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/ 2024-04-20T02:09:29.984 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1252.g15eecde2 2024-04-20T02:09:30.089 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T02:09:30.089 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:09:30.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T02:09:30.118 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-20T02:09:30.119 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/15eecde2bab9803889d929c7e423d07970d8cbed/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T02:09:30.155 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-04-18-1351-reef/15eecde2bab9803889d929c7e423d07970d8cbed/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T02:09:30.155 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:09:30.155 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T02:09:30.183 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-20T02:09:30.183 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/15eecde2bab9803889d929c7e423d07970d8cbed/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T02:09:30.188 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T02:09:30.251 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T02:09:30.267 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T02:09:30.328 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T02:09:30.332 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-04-20T02:09:30.334 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-04-20T02:09:30.394 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-04-20T02:09:30.395 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-04-20T02:09:30.710 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:09:30.772 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:09:32.321 INFO:teuthology.orchestra.run.smithi171.stdout:63 files removed 2024-04-20T02:09:32.378 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw 2024-04-20T02:09:32.428 INFO:teuthology.orchestra.run.smithi117.stdout:63 files removed 2024-04-20T02:09:32.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw 2024-04-20T02:09:32.714 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:09:32.816 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:09:34.730 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 184 kB/s | 80 kB 00:00 2024-04-20T02:09:35.150 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 132 kB/s | 80 kB 00:00 2024-04-20T02:09:35.155 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-04-20T02:09:35.464 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2024-04-20T02:09:35.623 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-20T02:09:36.710 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 7.5 kB/s | 11 kB 00:01 2024-04-20T02:09:36.791 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-20T02:09:37.002 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2024-04-20T02:09:37.153 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-04-20T02:09:40.249 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 16 MB 00:03 2024-04-20T02:09:40.432 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 503 kB/s | 24 kB 00:00 2024-04-20T02:09:41.651 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 60 MB 00:01 2024-04-20T02:09:43.853 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 314 kB/s | 24 kB 00:00 2024-04-20T02:09:45.246 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-04-20T02:09:52.476 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-04-20T02:09:55.394 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 67 MB 00:01 2024-04-20T02:09:55.429 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-04-20T02:09:58.397 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 60 MB 00:01 2024-04-20T02:10:10.716 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:10:10.718 INFO:teuthology.orchestra.run.smithi171.stdout:==================================================================================================== 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout:==================================================================================================== 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 13 M 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 3.7 M 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 3.6 M 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 5.5 M 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 22 M 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 24 k 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-20T02:10:10.719 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 781 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 474 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 6.5 M 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 45 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 129 k 2024-04-20T02:10:10.720 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 197 k 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 372 k 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 364 k 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 107 k 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout:==================================================================================================== 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout:Install 21 Packages 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 2 Packages 2024-04-20T02:10:10.721 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:10:10.722 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 59 M 2024-04-20T02:10:10.722 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:10:12.643 INFO:teuthology.orchestra.run.smithi171.stdout:(1/23): ceph-radosgw-18.2.2-1252.g15eecde2.el8. 8.3 MB/s | 13 MB 00:01 2024-04-20T02:10:12.852 INFO:teuthology.orchestra.run.smithi171.stdout:(2/23): ceph-common-18.2.2-1252.g15eecde2.el8.x 12 MB/s | 22 MB 00:01 2024-04-20T02:10:12.877 INFO:teuthology.orchestra.run.smithi171.stdout:(3/23): ceph-selinux-18.2.2-1252.g15eecde2.el8. 104 kB/s | 24 kB 00:00 2024-04-20T02:10:12.935 INFO:teuthology.orchestra.run.smithi171.stdout:(4/23): libcephfs2-18.2.2-1252.g15eecde2.el8.x8 9.2 MB/s | 781 kB 00:00 2024-04-20T02:10:12.996 INFO:teuthology.orchestra.run.smithi171.stdout:(5/23): libradosstriper1-18.2.2-1252.g15eecde2. 3.9 MB/s | 474 kB 00:00 2024-04-20T02:10:13.302 INFO:teuthology.orchestra.run.smithi171.stdout:(6/23): librgw2-18.2.2-1252.g15eecde2.el8.x86_6 18 MB/s | 6.5 MB 00:00 2024-04-20T02:10:13.328 INFO:teuthology.orchestra.run.smithi171.stdout:(7/23): python3-ceph-argparse-18.2.2-1252.g15ee 134 kB/s | 45 kB 00:00 2024-04-20T02:10:13.353 INFO:teuthology.orchestra.run.smithi171.stdout:(8/23): python3-ceph-common-18.2.2-1252.g15eecd 2.5 MB/s | 129 kB 00:00 2024-04-20T02:10:13.387 INFO:teuthology.orchestra.run.smithi171.stdout:(9/23): python3-cephfs-18.2.2-1252.g15eecde2.el 3.3 MB/s | 197 kB 00:00 2024-04-20T02:10:13.412 INFO:teuthology.orchestra.run.smithi171.stdout:(10/23): python3-rados-18.2.2-1252.g15eecde2.el 6.2 MB/s | 372 kB 00:00 2024-04-20T02:10:13.437 INFO:teuthology.orchestra.run.smithi171.stdout:(11/23): python3-rbd-18.2.2-1252.g15eecde2.el8. 7.1 MB/s | 364 kB 00:00 2024-04-20T02:10:13.462 INFO:teuthology.orchestra.run.smithi171.stdout:(12/23): python3-rgw-18.2.2-1252.g15eecde2.el8. 2.1 MB/s | 107 kB 00:00 2024-04-20T02:10:13.854 INFO:teuthology.orchestra.run.smithi171.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 150 kB/s | 59 kB 00:00 2024-04-20T02:10:14.063 INFO:teuthology.orchestra.run.smithi171.stdout:(14/23): gperftools-libs-2.7-9.el8.x86_64.rpm 490 kB/s | 306 kB 00:00 2024-04-20T02:10:14.080 INFO:teuthology.orchestra.run.smithi171.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 333 kB/s | 75 kB 00:00 2024-04-20T02:10:14.116 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:10:14.118 INFO:teuthology.orchestra.run.smithi117.stdout:==================================================================================================== 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout:==================================================================================================== 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 13 M 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 3.7 M 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 3.6 M 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 5.5 M 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 22 M 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 24 k 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-20T02:10:14.119 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 781 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 474 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 6.5 M 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 45 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 129 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 197 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 372 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 364 k 2024-04-20T02:10:14.120 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 107 k 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout:==================================================================================================== 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout:Install 21 Packages 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 59 M 2024-04-20T02:10:14.121 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:10:14.206 INFO:teuthology.orchestra.run.smithi171.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 352 kB/s | 44 kB 00:00 2024-04-20T02:10:14.331 INFO:teuthology.orchestra.run.smithi171.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2024-04-20T02:10:14.472 INFO:teuthology.orchestra.run.smithi171.stdout:(18/23): ceph-base-18.2.2-1252.g15eecde2.el8.x8 1.6 MB/s | 5.5 MB 00:03 2024-04-20T02:10:14.506 INFO:teuthology.orchestra.run.smithi171.stdout:(19/23): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2024-04-20T02:10:14.556 INFO:teuthology.orchestra.run.smithi171.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2024-04-20T02:10:14.648 INFO:teuthology.orchestra.run.smithi171.stdout:(21/23): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 268 kB/s | 47 kB 00:00 2024-04-20T02:10:15.065 INFO:teuthology.orchestra.run.smithi171.stdout:(22/23): librbd1-18.2.2-1252.g15eecde2.el8.x86_ 7.0 MB/s | 3.6 MB 00:00 2024-04-20T02:10:15.404 INFO:teuthology.orchestra.run.smithi117.stdout:(1/23): ceph-radosgw-18.2.2-1252.g15eecde2.el8. 13 MB/s | 13 MB 00:01 2024-04-20T02:10:15.438 INFO:teuthology.orchestra.run.smithi117.stdout:(2/23): ceph-selinux-18.2.2-1252.g15eecde2.el8. 739 kB/s | 24 kB 00:00 2024-04-20T02:10:15.537 INFO:teuthology.orchestra.run.smithi117.stdout:(3/23): libcephfs2-18.2.2-1252.g15eecde2.el8.x8 7.6 MB/s | 781 kB 00:00 2024-04-20T02:10:15.621 INFO:teuthology.orchestra.run.smithi117.stdout:(4/23): libradosstriper1-18.2.2-1252.g15eecde2. 5.6 MB/s | 474 kB 00:00 2024-04-20T02:10:16.038 INFO:teuthology.orchestra.run.smithi117.stdout:(5/23): librgw2-18.2.2-1252.g15eecde2.el8.x86_6 16 MB/s | 6.5 MB 00:00 2024-04-20T02:10:16.088 INFO:teuthology.orchestra.run.smithi117.stdout:(6/23): python3-ceph-argparse-18.2.2-1252.g15ee 897 kB/s | 45 kB 00:00 2024-04-20T02:10:16.146 INFO:teuthology.orchestra.run.smithi117.stdout:(7/23): python3-ceph-common-18.2.2-1252.g15eecd 2.2 MB/s | 129 kB 00:00 2024-04-20T02:10:16.213 INFO:teuthology.orchestra.run.smithi117.stdout:(8/23): python3-cephfs-18.2.2-1252.g15eecde2.el 2.9 MB/s | 197 kB 00:00 2024-04-20T02:10:16.223 INFO:teuthology.orchestra.run.smithi171.stdout:(23/23): librados2-18.2.2-1252.g15eecde2.el8.x8 2.2 MB/s | 3.7 MB 00:01 2024-04-20T02:10:16.225 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:10:16.226 INFO:teuthology.orchestra.run.smithi171.stdout:Total 11 MB/s | 59 MB 00:05 2024-04-20T02:10:16.271 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:10:16.280 INFO:teuthology.orchestra.run.smithi117.stdout:(9/23): python3-rados-18.2.2-1252.g15eecde2.el8 5.5 MB/s | 372 kB 00:00 2024-04-20T02:10:16.315 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:10:16.315 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:10:16.364 INFO:teuthology.orchestra.run.smithi117.stdout:(10/23): ceph-base-18.2.2-1252.g15eecde2.el8.x8 2.8 MB/s | 5.5 MB 00:01 2024-04-20T02:10:16.389 INFO:teuthology.orchestra.run.smithi117.stdout:(11/23): python3-rbd-18.2.2-1252.g15eecde2.el8. 3.3 MB/s | 364 kB 00:00 2024-04-20T02:10:16.423 INFO:teuthology.orchestra.run.smithi117.stdout:(12/23): python3-rgw-18.2.2-1252.g15eecde2.el8. 1.8 MB/s | 107 kB 00:00 2024-04-20T02:10:16.648 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:10:16.656 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:10:17.006 INFO:teuthology.orchestra.run.smithi117.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 101 kB/s | 59 kB 00:00 2024-04-20T02:10:17.198 INFO:teuthology.orchestra.run.smithi117.stdout:(14/23): gperftools-libs-2.7-9.el8.x86_64.rpm 379 kB/s | 306 kB 00:00 2024-04-20T02:10:17.290 INFO:teuthology.orchestra.run.smithi117.stdout:(15/23): libunwind-1.3.1-3.el8.x86_64.rpm 265 kB/s | 75 kB 00:00 2024-04-20T02:10:17.457 INFO:teuthology.orchestra.run.smithi117.stdout:(16/23): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 282 kB/s | 47 kB 00:00 2024-04-20T02:10:17.624 INFO:teuthology.orchestra.run.smithi117.stdout:(17/23): python3-prettytable-0.7.2-14.el8.noarc 264 kB/s | 44 kB 00:00 2024-04-20T02:10:17.766 INFO:teuthology.orchestra.run.smithi117.stdout:(18/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-04-20T02:10:17.808 INFO:teuthology.orchestra.run.smithi117.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2024-04-20T02:10:17.891 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:10:18.059 INFO:teuthology.orchestra.run.smithi117.stdout:(20/23): ceph-common-18.2.2-1252.g15eecde2.el8. 5.9 MB/s | 22 MB 00:03 2024-04-20T02:10:18.084 INFO:teuthology.orchestra.run.smithi117.stdout:(21/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.1 MB/s | 354 kB 00:00 2024-04-20T02:10:18.184 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2024-04-20T02:10:18.324 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-20T02:10:18.534 INFO:teuthology.orchestra.run.smithi117.stdout:(22/23): librbd1-18.2.2-1252.g15eecde2.el8.x86_ 7.5 MB/s | 3.6 MB 00:00 2024-04-20T02:10:18.726 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-20T02:10:19.008 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 3/25 2024-04-20T02:10:19.009 INFO:teuthology.orchestra.run.smithi117.stdout:(23/23): librados2-18.2.2-1252.g15eecde2.el8.x8 3.1 MB/s | 3.7 MB 00:01 2024-04-20T02:10:19.013 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:10:19.013 INFO:teuthology.orchestra.run.smithi117.stdout:Total 12 MB/s | 59 MB 00:04 2024-04-20T02:10:19.063 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:10:19.090 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 3/25 2024-04-20T02:10:19.108 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:10:19.108 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:10:19.263 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 4/25 2024-04-20T02:10:19.439 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:10:19.447 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:10:19.539 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2024-04-20T02:10:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 6/25 2024-04-20T02:10:20.136 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 6/25 2024-04-20T02:10:20.324 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 7/25 2024-04-20T02:10:20.387 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 7/25 2024-04-20T02:10:20.555 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 8/25 2024-04-20T02:10:20.721 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:10:20.724 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2024-04-20T02:10:20.791 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2024-04-20T02:10:20.901 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2024-04-20T02:10:20.909 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:18.2.2-1252.g15eecde2.el8. 10/25 2024-04-20T02:10:21.067 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-20T02:10:21.100 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 11/25 2024-04-20T02:10:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 12/25 2024-04-20T02:10:21.469 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-04-20T02:10:21.499 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_6 13/25 2024-04-20T02:10:21.553 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_6 13/25 2024-04-20T02:10:21.674 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2024-04-20T02:10:21.726 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 3/25 2024-04-20T02:10:21.826 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 3/25 2024-04-20T02:10:21.865 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2024-04-20T02:10:22.023 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 4/25 2024-04-20T02:10:22.299 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2024-04-20T02:10:22.525 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 6/25 2024-04-20T02:10:22.665 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2024-04-20T02:10:22.815 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 17/25 2024-04-20T02:10:22.884 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 17/25 2024-04-20T02:10:22.930 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 6/25 2024-04-20T02:10:23.150 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 7/25 2024-04-20T02:10:23.218 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 18/25 2024-04-20T02:10:23.232 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 7/25 2024-04-20T02:10:23.442 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2024-04-20T02:10:23.490 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2024-04-20T02:10:23.665 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 9/25 2024-04-20T02:10:23.844 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:18.2.2-1252.g15eecde2.el8. 10/25 2024-04-20T02:10:23.991 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:18.2.2-1252.g15eecde2.el8.x8 19/25 2024-04-20T02:10:24.069 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 11/25 2024-04-20T02:10:24.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 12/25 2024-04-20T02:10:24.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_6 13/25 2024-04-20T02:10:24.530 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_6 13/25 2024-04-20T02:10:24.692 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2024-04-20T02:10:24.884 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2024-04-20T02:10:25.683 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2024-04-20T02:10:25.875 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 17/25 2024-04-20T02:10:25.952 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 17/25 2024-04-20T02:10:26.225 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 18/25 2024-04-20T02:10:26.417 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:18.2.2-1252.g15eecde2.el8.x8 19/25 2024-04-20T02:10:27.740 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 20/25 2024-04-20T02:10:27.965 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 20/25 2024-04-20T02:10:28.557 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 20/25 2024-04-20T02:10:28.793 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 21/25 2024-04-20T02:10:28.877 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 21/25 2024-04-20T02:10:29.091 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 22/25 2024-04-20T02:10:30.195 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 20/25 2024-04-20T02:10:30.441 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 20/25 2024-04-20T02:10:31.031 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 20/25 2024-04-20T02:10:31.325 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 21/25 2024-04-20T02:10:31.404 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 21/25 2024-04-20T02:10:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 22/25 2024-04-20T02:10:48.489 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 22/25 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /run 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2024-04-20T02:10:48.490 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:10:49.807 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 23/25 2024-04-20T02:10:49.828 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 23/25 2024-04-20T02:10:49.829 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-20T02:10:50.055 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-20T02:10:50.055 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-20T02:10:50.657 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 22/25 2024-04-20T02:10:50.657 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-04-20T02:10:50.657 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-04-20T02:10:50.657 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2024-04-20T02:10:50.657 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /run 2024-04-20T02:10:50.657 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-04-20T02:10:50.658 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-04-20T02:10:50.658 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-04-20T02:10:50.658 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-04-20T02:10:50.658 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2024-04-20T02:10:50.658 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:10:50.696 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-20T02:10:50.696 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 1/25 2024-04-20T02:10:50.696 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 2/25 2024-04-20T02:10:50.696 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 3/25 2024-04-20T02:10:50.696 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 4/25 2024-04-20T02:10:50.696 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 5/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_6 6/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 7/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1252.g15eecde2.el8. 8/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:18.2.2-1252.g15eecde2.el8.x8 9/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 10/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 11/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 12/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 13/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-04-20T02:10:50.697 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 19/25 2024-04-20T02:10:50.698 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 20/25 2024-04-20T02:10:50.698 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 21/25 2024-04-20T02:10:50.698 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 22/25 2024-04-20T02:10:50.698 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-20T02:10:50.698 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 24/25 2024-04-20T02:10:51.987 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 23/25 2024-04-20T02:10:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 23/25 2024-04-20T02:10:52.009 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-20T02:10:52.238 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-04-20T02:10:52.238 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-20T02:10:52.905 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 1/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 2/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 3/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 4/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 5/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_6 6/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 7/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1252.g15eecde2.el8. 8/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:18.2.2-1252.g15eecde2.el8.x8 9/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 10/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 11/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 12/25 2024-04-20T02:10:52.906 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 13/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 18/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 20/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 21/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 22/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-04-20T02:10:52.907 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 24/25 2024-04-20T02:11:05.752 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-20T02:11:05.752 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.302 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.303 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:06.304 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:11:06.539 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-test 2024-04-20T02:11:06.892 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:11:07.844 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-04-20T02:11:07.845 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:11:08.408 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:08.409 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-04-20T02:11:08.409 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.409 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.409 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:11:08.409 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.410 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.410 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.410 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.410 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-20T02:11:08.410 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.410 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-20T02:11:08.411 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-20T02:11:08.411 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.411 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-20T02:11:08.411 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.411 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-20T02:11:08.411 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-20T02:11:08.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-20T02:11:08.412 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.413 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:08.413 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-20T02:11:08.413 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:08.413 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:11:08.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-test 2024-04-20T02:11:08.944 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 kB/s | 4.1 kB 00:00 2024-04-20T02:11:08.982 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:11:09.372 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 31 kB/s | 4.5 kB 00:00 2024-04-20T02:11:10.970 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 kB/s | 4.5 kB 00:00 2024-04-20T02:11:11.701 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 22 kB/s | 4.1 kB 00:00 2024-04-20T02:11:11.872 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 47 M 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 142 k 2024-04-20T02:11:11.873 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout:Install 6 Packages 2024-04-20T02:11:11.874 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:11.875 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 48 M 2024-04-20T02:11:11.875 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 213 M 2024-04-20T02:11:11.875 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:11:11.917 INFO:teuthology.orchestra.run.smithi117.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2024-04-20T02:11:12.135 INFO:teuthology.orchestra.run.smithi117.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.5 MB/s | 323 kB 00:00 2024-04-20T02:11:12.226 INFO:teuthology.orchestra.run.smithi117.stdout:(3/6): libcephsqlite-18.2.2-1252.g15eecde2.el8. 403 kB/s | 142 kB 00:00 2024-04-20T02:11:12.252 INFO:teuthology.orchestra.run.smithi117.stdout:(4/6): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2024-04-20T02:11:12.418 INFO:teuthology.orchestra.run.smithi117.stdout:(5/6): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 981 kB/s | 188 kB 00:00 2024-04-20T02:11:14.083 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:11:14.084 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================================ 2024-04-20T02:11:14.084 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:11:14.084 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================================ 2024-04-20T02:11:14.084 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:11:14.084 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 47 M 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 142 k 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================================ 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout:Install 6 Packages 2024-04-20T02:11:14.085 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:14.086 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 48 M 2024-04-20T02:11:14.086 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 213 M 2024-04-20T02:11:14.086 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:11:14.124 INFO:teuthology.orchestra.run.smithi171.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.8 MB/s | 70 kB 00:00 2024-04-20T02:11:14.282 INFO:teuthology.orchestra.run.smithi171.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-04-20T02:11:14.299 INFO:teuthology.orchestra.run.smithi171.stdout:(3/6): libcephsqlite-18.2.2-1252.g15eecde2.el8. 667 kB/s | 142 kB 00:00 2024-04-20T02:11:14.425 INFO:teuthology.orchestra.run.smithi171.stdout:(4/6): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2024-04-20T02:11:14.444 INFO:teuthology.orchestra.run.smithi117.stdout:(6/6): ceph-test-18.2.2-1252.g15eecde2.el8.x86_ 18 MB/s | 47 MB 00:02 2024-04-20T02:11:14.446 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:11:14.446 INFO:teuthology.orchestra.run.smithi117.stdout:Total 19 MB/s | 48 MB 00:02 2024-04-20T02:11:14.458 INFO:teuthology.orchestra.run.smithi171.stdout:(5/6): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-04-20T02:11:14.485 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:11:14.507 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:11:14.507 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:11:14.774 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:11:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:11:15.241 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:11:15.406 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 1/6 2024-04-20T02:11:15.497 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 1/6 2024-04-20T02:11:15.726 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-7.el8.x86_64 2/6 2024-04-20T02:11:15.948 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2024-04-20T02:11:16.117 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2024-04-20T02:11:16.297 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 5/6 2024-04-20T02:11:16.433 INFO:teuthology.orchestra.run.smithi171.stdout:(6/6): ceph-test-18.2.2-1252.g15eecde2.el8.x86_ 20 MB/s | 47 MB 00:02 2024-04-20T02:11:16.435 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:11:16.435 INFO:teuthology.orchestra.run.smithi171.stdout:Total 20 MB/s | 48 MB 00:02 2024-04-20T02:11:16.477 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:11:16.496 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:11:16.496 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:11:16.764 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:11:16.773 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:11:17.253 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:11:17.390 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 1/6 2024-04-20T02:11:17.470 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 1/6 2024-04-20T02:11:17.693 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jq-1.6-7.el8.x86_64 2/6 2024-04-20T02:11:17.857 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2024-04-20T02:11:18.027 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2024-04-20T02:11:18.189 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 5/6 2024-04-20T02:11:20.773 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 5/6 2024-04-20T02:11:21.019 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 6/6 2024-04-20T02:11:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 6/6 2024-04-20T02:11:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 1/6 2024-04-20T02:11:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 2/6 2024-04-20T02:11:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2024-04-20T02:11:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2024-04-20T02:11:21.283 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-7.el8.x86_64 5/6 2024-04-20T02:11:22.673 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 5/6 2024-04-20T02:11:22.878 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 6/6 2024-04-20T02:11:23.141 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 6/6 2024-04-20T02:11:23.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 1/6 2024-04-20T02:11:23.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 2/6 2024-04-20T02:11:23.141 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2024-04-20T02:11:23.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2024-04-20T02:11:23.142 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jq-1.6-7.el8.x86_64 5/6 2024-04-20T02:11:38.709 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 6/6 2024-04-20T02:11:38.709 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:11:39.232 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-7.el8.x86_64 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-20T02:11:39.233 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:39.234 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:11:39.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph 2024-04-20T02:11:39.729 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:11:40.459 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 6/6 2024-04-20T02:11:40.459 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:11:40.987 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:40.987 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: jq-1.6-7.el8.x86_64 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:40.988 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:11:41.159 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph 2024-04-20T02:11:41.501 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:11:41.890 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 31 kB/s | 4.1 kB 00:00 2024-04-20T02:11:42.287 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 kB/s | 4.5 kB 00:00 2024-04-20T02:11:43.723 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 kB/s | 4.5 kB 00:00 2024-04-20T02:11:44.399 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-04-20T02:11:44.774 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================= 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================= 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 6.4 k 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 2.3 M 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 1.6 M 2024-04-20T02:11:44.778 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 246 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 4.8 M 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 18 M 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-20T02:11:44.779 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-20T02:11:44.780 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-20T02:11:44.781 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-20T02:11:44.781 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:44.781 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:11:44.781 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================= 2024-04-20T02:11:44.781 INFO:teuthology.orchestra.run.smithi117.stdout:Install 32 Packages 2024-04-20T02:11:44.781 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:11:44.782 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 31 M 2024-04-20T02:11:44.782 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 124 M 2024-04-20T02:11:44.782 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:11:45.241 INFO:teuthology.orchestra.run.smithi117.stdout:(1/32): ceph-18.2.2-1252.g15eecde2.el8.x86_64.r 55 kB/s | 6.4 kB 00:00 2024-04-20T02:11:45.517 INFO:teuthology.orchestra.run.smithi117.stdout:(2/32): ceph-mds-18.2.2-1252.g15eecde2.el8.x86_ 5.8 MB/s | 2.3 MB 00:00 2024-04-20T02:11:45.809 INFO:teuthology.orchestra.run.smithi117.stdout:(3/32): ceph-mon-18.2.2-1252.g15eecde2.el8.x86_ 8.5 MB/s | 4.8 MB 00:00 2024-04-20T02:11:45.876 INFO:teuthology.orchestra.run.smithi117.stdout:(4/32): ceph-mgr-modules-core-18.2.2-1252.g15ee 3.6 MB/s | 246 kB 00:00 2024-04-20T02:11:45.984 INFO:teuthology.orchestra.run.smithi117.stdout:(5/32): ceph-mgr-18.2.2-1252.g15eecde2.el8.x86_ 1.8 MB/s | 1.6 MB 00:00 2024-04-20T02:11:46.035 INFO:teuthology.orchestra.run.smithi117.stdout:(6/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 275 kB/s | 44 kB 00:00 2024-04-20T02:11:46.160 INFO:teuthology.orchestra.run.smithi117.stdout:(7/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2024-04-20T02:11:46.257 INFO:teuthology.orchestra.run.smithi117.stdout:(8/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 680 kB/s | 185 kB 00:00 2024-04-20T02:11:46.294 INFO:teuthology.orchestra.run.smithi117.stdout:(9/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 2.8 MB/s | 384 kB 00:00 2024-04-20T02:11:46.366 INFO:teuthology.orchestra.run.smithi117.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2024-04-20T02:11:46.470 INFO:teuthology.orchestra.run.smithi117.stdout:(11/32): python3-jaraco-functools-2.0-4.el8.noa 100 kB/s | 18 kB 00:00 2024-04-20T02:11:46.495 INFO:teuthology.orchestra.run.smithi117.stdout:(12/32): python3-logutils-0.3.5-11.el8.noarch.r 378 kB/s | 49 kB 00:00 2024-04-20T02:11:46.561 INFO:teuthology.orchestra.run.smithi117.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 649 kB/s | 59 kB 00:00 2024-04-20T02:11:46.596 INFO:teuthology.orchestra.run.smithi117.stdout:(14/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2024-04-20T02:11:46.621 INFO:teuthology.orchestra.run.smithi117.stdout:(15/32): python3-portend-2.6-1.el8.noarch.rpm 260 kB/s | 16 kB 00:00 2024-04-20T02:11:46.655 INFO:teuthology.orchestra.run.smithi117.stdout:(16/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2024-04-20T02:11:46.680 INFO:teuthology.orchestra.run.smithi117.stdout:(17/32): python3-singledispatch-3.4.0.3-18.el8. 410 kB/s | 24 kB 00:00 2024-04-20T02:11:46.692 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================= 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================= 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 6.4 k 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 2.3 M 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 1.6 M 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 246 k 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 4.8 M 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 18 M 2024-04-20T02:11:46.696 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-20T02:11:46.697 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-20T02:11:46.698 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================= 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout:Install 32 Packages 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 31 M 2024-04-20T02:11:46.699 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 124 M 2024-04-20T02:11:46.700 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:11:46.713 INFO:teuthology.orchestra.run.smithi117.stdout:(18/32): python3-tempora-1.14.1-5.el8.noarch.rp 500 kB/s | 29 kB 00:00 2024-04-20T02:11:46.739 INFO:teuthology.orchestra.run.smithi117.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 470 kB/s | 27 kB 00:00 2024-04-20T02:11:46.964 INFO:teuthology.orchestra.run.smithi117.stdout:(20/32): ceph-osd-18.2.2-1252.g15eecde2.el8.x86 13 MB/s | 18 MB 00:01 2024-04-20T02:11:46.976 INFO:teuthology.orchestra.run.smithi171.stdout:(1/32): ceph-18.2.2-1252.g15eecde2.el8.x86_64.r 50 kB/s | 6.4 kB 00:00 2024-04-20T02:11:46.989 INFO:teuthology.orchestra.run.smithi117.stdout:(21/32): python3-waitress-1.4.3-1.el8.noarch.rp 927 kB/s | 255 kB 00:00 2024-04-20T02:11:47.014 INFO:teuthology.orchestra.run.smithi117.stdout:(22/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 912 kB/s | 251 kB 00:00 2024-04-20T02:11:47.081 INFO:teuthology.orchestra.run.smithi117.stdout:(23/32): python3-zc-lockfile-2.0-2.el8.noarch.r 345 kB/s | 23 kB 00:00 2024-04-20T02:11:47.190 INFO:teuthology.orchestra.run.smithi117.stdout:(24/32): python3-webtest-2.0.33-1.el8.noarch.rp 379 kB/s | 85 kB 00:00 2024-04-20T02:11:47.215 INFO:teuthology.orchestra.run.smithi117.stdout:(25/32): python3-pycparser-2.14-14.el8.noarch.r 545 kB/s | 109 kB 00:00 2024-04-20T02:11:47.240 INFO:teuthology.orchestra.run.smithi117.stdout:(26/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-04-20T02:11:47.350 INFO:teuthology.orchestra.run.smithi171.stdout:(2/32): ceph-mgr-18.2.2-1252.g15eecde2.el8.x86_ 3.1 MB/s | 1.6 MB 00:00 2024-04-20T02:11:47.374 INFO:teuthology.orchestra.run.smithi117.stdout:(27/32): python3-cryptography-3.2.1-7.el8_9.x86 3.0 MB/s | 559 kB 00:00 2024-04-20T02:11:47.400 INFO:teuthology.orchestra.run.smithi117.stdout:(28/32): python3-markupsafe-0.23-19.el8.x86_64. 245 kB/s | 39 kB 00:00 2024-04-20T02:11:47.464 INFO:teuthology.orchestra.run.smithi117.stdout:(29/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.8 MB/s | 457 kB 00:00 2024-04-20T02:11:47.500 INFO:teuthology.orchestra.run.smithi117.stdout:(30/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 824 kB/s | 103 kB 00:00 2024-04-20T02:11:47.525 INFO:teuthology.orchestra.run.smithi117.stdout:(31/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-04-20T02:11:47.609 INFO:teuthology.orchestra.run.smithi117.stdout:(32/32): python3-pytz-2017.2-11.el8.noarch.rpm 376 kB/s | 54 kB 00:00 2024-04-20T02:11:47.610 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:11:47.610 INFO:teuthology.orchestra.run.smithi117.stdout:Total 11 MB/s | 31 MB 00:02 2024-04-20T02:11:47.703 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:11:47.741 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:11:47.741 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:11:47.784 INFO:teuthology.orchestra.run.smithi171.stdout:(3/32): ceph-mon-18.2.2-1252.g15eecde2.el8.x86_ 6.0 MB/s | 4.8 MB 00:00 2024-04-20T02:11:47.901 INFO:teuthology.orchestra.run.smithi171.stdout:(4/32): ceph-mds-18.2.2-1252.g15eecde2.el8.x86_ 2.2 MB/s | 2.3 MB 00:01 2024-04-20T02:11:47.966 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:11:47.974 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:11:48.068 INFO:teuthology.orchestra.run.smithi171.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 262 kB/s | 44 kB 00:00 2024-04-20T02:11:48.101 INFO:teuthology.orchestra.run.smithi171.stdout:(6/32): ceph-mgr-modules-core-18.2.2-1252.g15ee 775 kB/s | 246 kB 00:00 2024-04-20T02:11:48.235 INFO:teuthology.orchestra.run.smithi171.stdout:(7/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.1 MB/s | 185 kB 00:00 2024-04-20T02:11:48.369 INFO:teuthology.orchestra.run.smithi171.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 2.8 MB/s | 384 kB 00:00 2024-04-20T02:11:48.427 INFO:teuthology.orchestra.run.smithi171.stdout:(9/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2024-04-20T02:11:48.494 INFO:teuthology.orchestra.run.smithi171.stdout:(10/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2024-04-20T02:11:48.553 INFO:teuthology.orchestra.run.smithi171.stdout:(11/32): python3-logutils-0.3.5-11.el8.noarch.r 837 kB/s | 49 kB 00:00 2024-04-20T02:11:48.745 INFO:teuthology.orchestra.run.smithi171.stdout:(12/32): ceph-osd-18.2.2-1252.g15eecde2.el8.x86 13 MB/s | 18 MB 00:01 2024-04-20T02:11:48.770 INFO:teuthology.orchestra.run.smithi171.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 271 kB/s | 59 kB 00:00 2024-04-20T02:11:48.837 INFO:teuthology.orchestra.run.smithi171.stdout:(14/32): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2024-04-20T02:11:48.934 INFO:teuthology.orchestra.run.smithi171.stdout:(15/32): python3-simplegeneric-0.8.1-17.el8.noa 194 kB/s | 19 kB 00:00 2024-04-20T02:11:48.996 INFO:teuthology.orchestra.run.smithi171.stdout:(16/32): python3-singledispatch-3.4.0.3-18.el8. 388 kB/s | 24 kB 00:00 2024-04-20T02:11:49.021 INFO:teuthology.orchestra.run.smithi171.stdout:(17/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2024-04-20T02:11:49.055 INFO:teuthology.orchestra.run.smithi171.stdout:(18/32): python3-tempora-1.14.1-5.el8.noarch.rp 499 kB/s | 29 kB 00:00 2024-04-20T02:11:49.080 INFO:teuthology.orchestra.run.smithi171.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 471 kB/s | 27 kB 00:00 2024-04-20T02:11:49.130 INFO:teuthology.orchestra.run.smithi171.stdout:(20/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-04-20T02:11:49.143 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:11:49.172 INFO:teuthology.orchestra.run.smithi171.stdout:(21/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.7 MB/s | 251 kB 00:00 2024-04-20T02:11:49.197 INFO:teuthology.orchestra.run.smithi171.stdout:(22/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s | 85 kB 00:00 2024-04-20T02:11:49.231 INFO:teuthology.orchestra.run.smithi171.stdout:(23/32): python3-zc-lockfile-2.0-2.el8.noarch.r 392 kB/s | 23 kB 00:00 2024-04-20T02:11:49.339 INFO:teuthology.orchestra.run.smithi171.stdout:(24/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 139 kB/s | 173 kB 00:01 2024-04-20T02:11:49.378 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-20T02:11:49.390 INFO:teuthology.orchestra.run.smithi171.stdout:(25/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.3 MB/s | 457 kB 00:00 2024-04-20T02:11:49.423 INFO:teuthology.orchestra.run.smithi171.stdout:(26/32): python3-markupsafe-0.23-19.el8.x86_64. 208 kB/s | 39 kB 00:00 2024-04-20T02:11:49.499 INFO:teuthology.orchestra.run.smithi171.stdout:(27/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 651 kB/s | 103 kB 00:00 2024-04-20T02:11:49.578 INFO:teuthology.orchestra.run.smithi171.stdout:(28/32): python3-mako-1.0.6-14.el8.noarch.rpm 836 kB/s | 157 kB 00:00 2024-04-20T02:11:49.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-20T02:11:49.666 INFO:teuthology.orchestra.run.smithi171.stdout:(29/32): python3-pytz-2017.2-11.el8.noarch.rpm 223 kB/s | 54 kB 00:00 2024-04-20T02:11:49.776 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 3/32 2024-04-20T02:11:49.923 INFO:teuthology.orchestra.run.smithi171.stdout:(30/32): python3-pycparser-2.14-14.el8.noarch.r 257 kB/s | 109 kB 00:00 2024-04-20T02:11:49.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/32 2024-04-20T02:11:50.325 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 5/32 2024-04-20T02:11:50.372 INFO:teuthology.orchestra.run.smithi171.stdout:(31/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 300 kB/s | 238 kB 00:00 2024-04-20T02:11:50.568 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/32 2024-04-20T02:11:50.734 INFO:teuthology.orchestra.run.smithi171.stdout:(32/32): python3-cryptography-3.2.1-7.el8_9.x86 524 kB/s | 559 kB 00:01 2024-04-20T02:11:50.735 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:11:50.736 INFO:teuthology.orchestra.run.smithi171.stdout:Total 7.7 MB/s | 31 MB 00:04 2024-04-20T02:11:50.775 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 7/32 2024-04-20T02:11:50.832 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:11:50.870 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:11:50.870 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:11:51.095 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:11:51.104 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:11:51.136 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 8/32 2024-04-20T02:11:51.598 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 9/32 2024-04-20T02:11:52.189 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:11:52.430 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-20T02:11:52.629 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-20T02:11:52.827 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/32 2024-04-20T02:11:52.961 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 10/32 2024-04-20T02:11:53.215 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 4/32 2024-04-20T02:11:53.470 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 5/32 2024-04-20T02:11:53.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 6/32 2024-04-20T02:11:53.809 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 7/32 2024-04-20T02:11:53.958 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 11/32 2024-04-20T02:11:54.006 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 8/32 2024-04-20T02:11:54.203 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 12/32 2024-04-20T02:11:54.205 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 9/32 2024-04-20T02:11:54.417 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 10/32 2024-04-20T02:11:54.453 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2024-04-20T02:11:54.668 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 14/32 2024-04-20T02:11:54.695 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 11/32 2024-04-20T02:11:54.843 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2024-04-20T02:11:54.934 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 12/32 2024-04-20T02:11:55.008 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2024-04-20T02:11:55.148 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2024-04-20T02:11:55.208 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2024-04-20T02:11:55.353 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2024-04-20T02:11:55.360 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 14/32 2024-04-20T02:11:55.521 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2024-04-20T02:11:55.584 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2024-04-20T02:11:55.712 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2024-04-20T02:11:55.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2024-04-20T02:11:55.870 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2024-04-20T02:11:55.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2024-04-20T02:11:56.053 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-20T02:11:56.212 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2024-04-20T02:11:56.309 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-20T02:11:56.553 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-20T02:11:56.789 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2024-04-20T02:11:57.113 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2024-04-20T02:11:57.171 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2024-04-20T02:11:57.331 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-20T02:11:57.469 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-20T02:11:57.562 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-20T02:11:57.789 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-20T02:11:57.861 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1252.g15eecde2.el8. 27/32 2024-04-20T02:11:58.001 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2024-04-20T02:11:58.031 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 28/32 2024-04-20T02:11:58.279 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2024-04-20T02:11:58.612 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-20T02:11:59.042 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1252.g15eecde2.el8. 27/32 2024-04-20T02:11:59.196 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 28/32 2024-04-20T02:11:59.671 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 28/32 2024-04-20T02:11:59.930 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 29/32 2024-04-20T02:12:00.410 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 29/32 2024-04-20T02:12:00.604 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 30/32 2024-04-20T02:12:00.818 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 30/32 2024-04-20T02:12:00.843 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 28/32 2024-04-20T02:12:00.979 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 31/32 2024-04-20T02:12:00.997 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 31/32 2024-04-20T02:12:01.045 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 29/32 2024-04-20T02:12:01.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 32/32 2024-04-20T02:12:01.526 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 29/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 32/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 1/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 2/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 3/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 4/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 5/32 2024-04-20T02:12:01.545 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1252.g15eecde2.el8. 6/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2024-04-20T02:12:01.546 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2024-04-20T02:12:01.547 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/32 2024-04-20T02:12:01.547 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2024-04-20T02:12:01.547 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2024-04-20T02:12:01.547 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2024-04-20T02:12:01.547 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 25/32 2024-04-20T02:12:01.548 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 26/32 2024-04-20T02:12:01.548 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 27/32 2024-04-20T02:12:01.548 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2024-04-20T02:12:01.548 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 29/32 2024-04-20T02:12:01.548 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 30/32 2024-04-20T02:12:01.548 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 31/32 2024-04-20T02:12:01.683 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 30/32 2024-04-20T02:12:01.897 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 30/32 2024-04-20T02:12:02.058 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 31/32 2024-04-20T02:12:02.077 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 31/32 2024-04-20T02:12:02.181 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 32/32 2024-04-20T02:12:02.559 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 32/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 1/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 2/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 3/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 4/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 5/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1252.g15eecde2.el8. 6/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2024-04-20T02:12:02.560 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2024-04-20T02:12:02.561 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 25/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 27/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 28/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 29/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 30/32 2024-04-20T02:12:02.562 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 31/32 2024-04-20T02:12:15.402 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 32/32 2024-04-20T02:12:15.402 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:12:15.972 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-20T02:12:15.973 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-2.6-1.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-20T02:12:15.974 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:15.975 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:12:16.163 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-base 2024-04-20T02:12:16.515 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:12:17.262 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 32/32 2024-04-20T02:12:17.262 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:12:17.803 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:17.803 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-20T02:12:17.804 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-2.6-1.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-20T02:12:17.805 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-20T02:12:17.806 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-20T02:12:17.806 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-20T02:12:17.806 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-20T02:12:17.806 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:17.806 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:12:17.991 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-base 2024-04-20T02:12:18.343 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:12:18.567 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 27 kB/s | 4.1 kB 00:00 2024-04-20T02:12:18.971 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 33 kB/s | 4.5 kB 00:00 2024-04-20T02:12:20.533 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 33 kB/s | 4.5 kB 00:00 2024-04-20T02:12:21.164 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 kB/s | 4.1 kB 00:00 2024-04-20T02:12:21.350 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:12:21.537 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:12:21.538 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:12:21.538 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:12:21.677 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install cephadm 2024-04-20T02:12:22.027 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:12:23.273 INFO:teuthology.orchestra.run.smithi171.stdout:Package ceph-base-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:12:23.454 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:12:23.456 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:12:23.456 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:12:23.605 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install cephadm 2024-04-20T02:12:23.954 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:12:24.242 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-04-20T02:12:24.619 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 kB/s | 4.5 kB 00:00 2024-04-20T02:12:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 kB/s | 4.5 kB 00:00 2024-04-20T02:12:26.854 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 41 kB/s | 4.1 kB 00:00 2024-04-20T02:12:27.173 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:12:27.174 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:12:27.174 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 173 k 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 173 k 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 692 k 2024-04-20T02:12:27.175 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:12:27.470 INFO:teuthology.orchestra.run.smithi117.stdout:cephadm-18.2.2-1252.g15eecde2.el8.noarch.rpm 586 kB/s | 173 kB 00:00 2024-04-20T02:12:27.470 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:12:27.470 INFO:teuthology.orchestra.run.smithi117.stdout:Total 584 kB/s | 173 kB 00:00 2024-04-20T02:12:27.471 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:12:27.479 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:12:27.479 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:12:27.481 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:12:27.490 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:12:27.562 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:12:29.140 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:12:29.141 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:12:29.141 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:12:29.141 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:12:29.141 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:12:29.141 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 173 k 2024-04-20T02:12:29.141 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 173 k 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 692 k 2024-04-20T02:12:29.142 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:12:29.311 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:29.495 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:29.694 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:29.707 INFO:teuthology.orchestra.run.smithi171.stdout:cephadm-18.2.2-1252.g15eecde2.el8.noarch.rpm 305 kB/s | 173 kB 00:00 2024-04-20T02:12:29.708 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:12:29.708 INFO:teuthology.orchestra.run.smithi171.stdout:Total 305 kB/s | 173 kB 00:00 2024-04-20T02:12:29.708 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:12:29.717 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:12:29.717 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:12:29.719 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:12:29.728 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:12:29.776 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:12:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:31.686 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:31.889 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:42.594 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:42.595 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:12:43.169 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:43.169 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:12:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:12:43.170 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:43.170 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:12:43.332 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-immutable-object-cache 2024-04-20T02:12:43.695 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:12:43.794 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/1 2024-04-20T02:12:43.794 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:12:44.327 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:44.327 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:12:44.327 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:12:44.328 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:44.328 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:12:44.492 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-immutable-object-cache 2024-04-20T02:12:44.857 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:12:45.668 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-04-20T02:12:46.089 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 kB/s | 4.5 kB 00:00 2024-04-20T02:12:46.791 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 kB/s | 4.5 kB 00:00 2024-04-20T02:12:47.460 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-04-20T02:12:48.602 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:12:48.602 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:12:48.602 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-20T02:12:48.602 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:12:48.602 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 166 k 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 166 k 2024-04-20T02:12:48.603 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 503 k 2024-04-20T02:12:48.604 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:12:49.150 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-immutable-object-cache-18.2.2-1252.g15eecd 303 kB/s | 166 kB 00:00 2024-04-20T02:12:49.151 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:12:49.151 INFO:teuthology.orchestra.run.smithi117.stdout:Total 302 kB/s | 166 kB 00:00 2024-04-20T02:12:49.152 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:12:49.164 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:12:49.164 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:12:49.221 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:12:49.230 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:12:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:12:49.502 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2. 1/1 2024-04-20T02:12:49.754 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:12:49.754 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:12:49.754 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repo Size 2024-04-20T02:12:49.754 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:12:49.754 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:12:49.754 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 166 k 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 166 k 2024-04-20T02:12:49.755 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 503 k 2024-04-20T02:12:49.756 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:12:49.895 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2. 1/1 2024-04-20T02:12:50.063 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-immutable-object-cache-18.2.2-1252.g15eecd 539 kB/s | 166 kB 00:00 2024-04-20T02:12:50.063 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:12:50.064 INFO:teuthology.orchestra.run.smithi171.stdout:Total 537 kB/s | 166 kB 00:00 2024-04-20T02:12:50.064 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:12:50.075 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:12:50.076 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:12:50.128 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:12:50.137 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:12:50.259 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:12:50.417 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2. 1/1 2024-04-20T02:12:50.813 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2. 1/1 2024-04-20T02:13:04.473 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2. 1/1 2024-04-20T02:13:04.473 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:13:05.008 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:05.008 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:13:05.008 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:13:05.008 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:05.008 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:13:05.214 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr 2024-04-20T02:13:05.430 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2. 1/1 2024-04-20T02:13:05.430 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:13:05.570 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:13:05.971 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:05.971 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:13:05.971 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:13:05.971 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:05.972 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:13:06.150 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-mgr 2024-04-20T02:13:06.502 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:13:07.515 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 34 kB/s | 4.1 kB 00:00 2024-04-20T02:13:07.879 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 kB/s | 4.5 kB 00:00 2024-04-20T02:13:08.259 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-04-20T02:13:08.921 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 kB/s | 4.1 kB 00:00 2024-04-20T02:13:10.196 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:13:10.385 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:13:10.386 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:13:10.386 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:13:10.528 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-dashboard 2024-04-20T02:13:10.875 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:13:11.036 INFO:teuthology.orchestra.run.smithi171.stdout:Package ceph-mgr-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:13:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:13:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:13:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:13:11.371 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-mgr-dashboard 2024-04-20T02:13:11.719 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:13:12.975 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-04-20T02:13:13.361 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 kB/s | 4.5 kB 00:00 2024-04-20T02:13:13.890 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-04-20T02:13:14.558 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 kB/s | 4.1 kB 00:00 2024-04-20T02:13:15.861 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 3.5 M 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 24 k 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 15 k 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-20T02:13:15.862 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-20T02:13:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:15.863 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:13:15.863 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:13:15.863 INFO:teuthology.orchestra.run.smithi117.stdout:Install 5 Packages 2024-04-20T02:13:15.863 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:15.863 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 3.8 M 2024-04-20T02:13:15.864 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 87 M 2024-04-20T02:13:15.864 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:13:16.352 INFO:teuthology.orchestra.run.smithi117.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1252.g15ee 105 kB/s | 15 kB 00:00 2024-04-20T02:13:16.411 INFO:teuthology.orchestra.run.smithi117.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1252.g15e 119 kB/s | 24 kB 00:00 2024-04-20T02:13:16.503 INFO:teuthology.orchestra.run.smithi117.stdout:(3/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 224 kB/s | 34 kB 00:00 2024-04-20T02:13:16.553 INFO:teuthology.orchestra.run.smithi117.stdout:(4/5): python3-routes-2.4.1-12.el8.noarch.rpm 1.4 MB/s | 196 kB 00:00 2024-04-20T02:13:16.828 INFO:teuthology.orchestra.run.smithi117.stdout:(5/5): ceph-mgr-dashboard-18.2.2-1252.g15eecde2 5.7 MB/s | 3.5 MB 00:00 2024-04-20T02:13:16.831 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:13:16.831 INFO:teuthology.orchestra.run.smithi117.stdout:Total 3.9 MB/s | 3.8 MB 00:00 2024-04-20T02:13:16.832 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:13:16.839 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:13:16.840 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:13:16.848 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:13:16.849 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:13:16.849 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:13:16.849 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 3.5 M 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 24 k 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 15 k 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout:Install 5 Packages 2024-04-20T02:13:16.850 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:16.851 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 3.8 M 2024-04-20T02:13:16.851 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 87 M 2024-04-20T02:13:16.851 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:13:16.907 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:13:16.916 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:13:17.179 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:13:17.199 INFO:teuthology.orchestra.run.smithi171.stdout:(1/5): ceph-grafana-dashboards-18.2.2-1252.g15e 116 kB/s | 24 kB 00:00 2024-04-20T02:13:17.216 INFO:teuthology.orchestra.run.smithi171.stdout:(2/5): ceph-prometheus-alerts-18.2.2-1252.g15ee 67 kB/s | 15 kB 00:00 2024-04-20T02:13:17.359 INFO:teuthology.orchestra.run.smithi171.stdout:(3/5): ceph-mgr-dashboard-18.2.2-1252.g15eecde2 9.6 MB/s | 3.5 MB 00:00 2024-04-20T02:13:17.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-20T02:13:17.475 INFO:teuthology.orchestra.run.smithi171.stdout:(4/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 122 kB/s | 34 kB 00:00 2024-04-20T02:13:17.656 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-20T02:13:17.667 INFO:teuthology.orchestra.run.smithi171.stdout:(5/5): python3-routes-2.4.1-12.el8.noarch.rpm 436 kB/s | 196 kB 00:00 2024-04-20T02:13:17.669 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:13:17.669 INFO:teuthology.orchestra.run.smithi171.stdout:Total 4.6 MB/s | 3.8 MB 00:00 2024-04-20T02:13:17.669 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:13:17.677 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:13:17.678 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:13:17.747 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:13:17.755 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:13:17.820 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1252.g15eecde2.el8.n 3/5 2024-04-20T02:13:17.982 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:13:18.184 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/5 2024-04-20T02:13:18.373 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/5 2024-04-20T02:13:18.509 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1252.g15eecde2.el8.n 3/5 2024-04-20T02:13:18.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1252.g15eecde2.el8. 4/5 2024-04-20T02:13:19.246 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarc 5/5 2024-04-20T02:13:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarc 5/5 2024-04-20T02:13:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1252.g15eecde2.el8. 1/5 2024-04-20T02:13:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarc 2/5 2024-04-20T02:13:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1252.g15eecde2.el8.n 3/5 2024-04-20T02:13:19.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-20T02:13:19.656 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1252.g15eecde2.el8. 4/5 2024-04-20T02:13:19.899 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarc 5/5 2024-04-20T02:13:20.174 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarc 5/5 2024-04-20T02:13:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1252.g15eecde2.el8. 1/5 2024-04-20T02:13:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarc 2/5 2024-04-20T02:13:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1252.g15eecde2.el8.n 3/5 2024-04-20T02:13:20.175 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/5 2024-04-20T02:13:35.549 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-20T02:13:35.549 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:13:35.927 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/5 2024-04-20T02:13:35.927 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:36.125 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:13:36.301 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-20T02:13:36.527 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-20T02:13:36.528 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:36.528 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:13:36.652 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:13:36.697 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-20T02:13:37.052 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:13:38.547 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 31 kB/s | 4.1 kB 00:00 2024-04-20T02:13:38.894 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 kB/s | 4.5 kB 00:00 2024-04-20T02:13:39.064 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 39 kB/s | 4.5 kB 00:00 2024-04-20T02:13:39.762 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 28 kB/s | 4.1 kB 00:00 2024-04-20T02:13:41.531 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:13:41.532 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================================= 2024-04-20T02:13:41.532 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:13:41.532 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================================= 2024-04-20T02:13:41.532 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:13:41.532 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 7.4 M 2024-04-20T02:13:41.532 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================================= 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout:Install 8 Packages 2024-04-20T02:13:41.533 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:13:41.534 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 36 M 2024-04-20T02:13:41.534 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 207 M 2024-04-20T02:13:41.534 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:13:41.716 INFO:teuthology.orchestra.run.smithi117.stdout:(1/8): libquadmath-8.5.0-20.el8.x86_64.rpm 951 kB/s | 172 kB 00:00 2024-04-20T02:13:41.750 INFO:teuthology.orchestra.run.smithi117.stdout:(2/8): libgfortran-8.5.0-20.el8.x86_64.rpm 2.9 MB/s | 645 kB 00:00 2024-04-20T02:13:41.892 INFO:teuthology.orchestra.run.smithi117.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 21 MB/s | 3.7 MB 00:00 2024-04-20T02:13:41.917 INFO:teuthology.orchestra.run.smithi117.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.3 MB/s | 225 kB 00:00 2024-04-20T02:13:42.134 INFO:teuthology.orchestra.run.smithi117.stdout:(5/8): openblas-threads-0.3.15-6.el8.x86_64.rpm 22 MB/s | 5.2 MB 00:00 2024-04-20T02:13:42.182 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:13:42.183 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================================= 2024-04-20T02:13:42.183 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:13:42.183 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================================= 2024-04-20T02:13:42.184 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 7.4 M 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-20T02:13:42.185 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================================= 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout:Install 8 Packages 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:13:42.186 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 36 M 2024-04-20T02:13:42.187 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 207 M 2024-04-20T02:13:42.187 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:13:42.267 INFO:teuthology.orchestra.run.smithi117.stdout:(6/8): ceph-mgr-diskprediction-local-18.2.2-125 10 MB/s | 7.4 MB 00:00 2024-04-20T02:13:42.368 INFO:teuthology.orchestra.run.smithi117.stdout:(7/8): openblas-0.3.15-6.el8.x86_64.rpm 11 MB/s | 5.0 MB 00:00 2024-04-20T02:13:42.373 INFO:teuthology.orchestra.run.smithi171.stdout:(1/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.2 MB/s | 225 kB 00:00 2024-04-20T02:13:42.440 INFO:teuthology.orchestra.run.smithi171.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 15 MB/s | 3.7 MB 00:00 2024-04-20T02:13:42.593 INFO:teuthology.orchestra.run.smithi117.stdout:(8/8): python3-scipy-1.0.0-21.module+el8.9.0+20 30 MB/s | 14 MB 00:00 2024-04-20T02:13:42.594 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:13:42.594 INFO:teuthology.orchestra.run.smithi117.stdout:Total 34 MB/s | 36 MB 00:01 2024-04-20T02:13:42.598 INFO:teuthology.orchestra.run.smithi171.stdout:(3/8): openblas-threads-0.3.15-6.el8.x86_64.rpm 23 MB/s | 5.2 MB 00:00 2024-04-20T02:13:42.715 INFO:teuthology.orchestra.run.smithi171.stdout:(4/8): openblas-0.3.15-6.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2024-04-20T02:13:42.841 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:13:42.859 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:13:42.860 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:13:43.016 INFO:teuthology.orchestra.run.smithi171.stdout:(5/8): python3-scipy-1.0.0-21.module+el8.9.0+20 33 MB/s | 14 MB 00:00 2024-04-20T02:13:43.049 INFO:teuthology.orchestra.run.smithi171.stdout:(6/8): libgfortran-8.5.0-20.el8.x86_64.rpm 1.9 MB/s | 645 kB 00:00 2024-04-20T02:13:43.133 INFO:teuthology.orchestra.run.smithi171.stdout:(7/8): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-04-20T02:13:43.168 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:13:43.177 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:13:43.726 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:13:43.889 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 1/8 2024-04-20T02:13:44.025 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 1/8 2024-04-20T02:13:44.206 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 2/8 2024-04-20T02:13:44.835 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 2/8 2024-04-20T02:13:45.014 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 3/8 2024-04-20T02:13:45.200 INFO:teuthology.orchestra.run.smithi171.stdout:(8/8): ceph-mgr-diskprediction-local-18.2.2-125 2.5 MB/s | 7.4 MB 00:03 2024-04-20T02:13:45.201 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:13:45.201 INFO:teuthology.orchestra.run.smithi171.stdout:Total 12 MB/s | 36 MB 00:03 2024-04-20T02:13:45.451 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:13:45.470 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:13:45.470 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:13:45.624 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 3/8 2024-04-20T02:13:45.779 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:13:45.788 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:13:45.856 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.15-6.el8.x86_64 4/8 2024-04-20T02:13:46.329 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:13:46.522 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 4/8 2024-04-20T02:13:46.599 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 1/8 2024-04-20T02:13:46.725 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 1/8 2024-04-20T02:13:46.859 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-20T02:13:46.865 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 2/8 2024-04-20T02:13:47.089 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-20T02:13:47.476 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 2/8 2024-04-20T02:13:47.673 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 3/8 2024-04-20T02:13:48.274 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 3/8 2024-04-20T02:13:48.474 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.15-6.el8.x86_64 4/8 2024-04-20T02:13:48.849 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-20T02:13:49.157 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 4/8 2024-04-20T02:13:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-04-20T02:13:49.698 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-20T02:13:50.708 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525 7/8 2024-04-20T02:13:50.929 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde 8/8 2024-04-20T02:13:51.226 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde 8/8 2024-04-20T02:13:51.226 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde 1/8 2024-04-20T02:13:51.226 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 2/8 2024-04-20T02:13:51.227 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 3/8 2024-04-20T02:13:51.227 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-04-20T02:13:51.227 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-04-20T02:13:51.227 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 6/8 2024-04-20T02:13:51.227 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 7/8 2024-04-20T02:13:51.460 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-04-20T02:13:53.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525 7/8 2024-04-20T02:13:53.631 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde 8/8 2024-04-20T02:13:53.932 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde 8/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde 1/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 2/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 3/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 4/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 5/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525 6/8 2024-04-20T02:13:53.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 7/8 2024-04-20T02:14:05.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525 8/8 2024-04-20T02:14:05.633 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:14:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:06.182 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:14:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:14:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-20T02:14:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-20T02:14:06.182 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-20T02:14:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-20T02:14:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-20T02:14:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-20T02:14:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-20T02:14:06.183 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:06.183 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:14:06.383 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-rook 2024-04-20T02:14:06.733 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:14:07.923 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 8/8 2024-04-20T02:14:07.923 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:08.492 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:14:08.621 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 4.1 kB 00:00 2024-04-20T02:14:08.665 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-mgr-rook 2024-04-20T02:14:09.016 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:14:09.151 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 18 kB/s | 4.5 kB 00:00 2024-04-20T02:14:11.120 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 23 kB/s | 4.5 kB 00:00 2024-04-20T02:14:11.783 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:14:11.785 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2024-04-20T02:14:11.785 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:14:11.785 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2024-04-20T02:14:11.785 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:14:11.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 49 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-20T02:14:11.786 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout:Install 14 Packages 2024-04-20T02:14:11.787 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:11.788 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.0 M 2024-04-20T02:14:11.788 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 25 M 2024-04-20T02:14:11.788 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:14:11.941 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 15 kB/s | 4.1 kB 00:00 2024-04-20T02:14:12.389 INFO:teuthology.orchestra.run.smithi117.stdout:(1/14): python3-certifi-2018.10.15-7.el8.noarch 61 kB/s | 16 kB 00:00 2024-04-20T02:14:12.446 INFO:teuthology.orchestra.run.smithi117.stdout:(2/14): python3-cachetools-3.1.1-4.el8.noarch.r 102 kB/s | 33 kB 00:00 2024-04-20T02:14:12.557 INFO:teuthology.orchestra.run.smithi117.stdout:(3/14): python3-google-auth-1.1.1-10.el8.noarch 487 kB/s | 81 kB 00:00 2024-04-20T02:14:12.648 INFO:teuthology.orchestra.run.smithi117.stdout:(4/14): python3-rsa-4.9-2.el8.noarch.rpm 702 kB/s | 64 kB 00:00 2024-04-20T02:14:12.774 INFO:teuthology.orchestra.run.smithi117.stdout:(5/14): python3-websocket-client-0.56.0-5.el8.n 490 kB/s | 61 kB 00:00 2024-04-20T02:14:12.807 INFO:teuthology.orchestra.run.smithi117.stdout:(6/14): python3-kubernetes-11.0.0-6.el8.noarch. 3.2 MB/s | 1.2 MB 00:00 2024-04-20T02:14:13.183 INFO:teuthology.orchestra.run.smithi117.stdout:(7/14): python3-jwt-1.6.1-2.el8.noarch.rpm 104 kB/s | 43 kB 00:00 2024-04-20T02:14:13.208 INFO:teuthology.orchestra.run.smithi117.stdout:(8/14): python3-oauthlib-2.1.0-1.el8.noarch.rpm 392 kB/s | 155 kB 00:00 2024-04-20T02:14:13.400 INFO:teuthology.orchestra.run.smithi117.stdout:(9/14): python3-requests-oauthlib-1.0.0-1.el8.n 197 kB/s | 43 kB 00:00 2024-04-20T02:14:13.450 INFO:teuthology.orchestra.run.smithi117.stdout:(10/14): python3-jsonpointer-1.10-11.el8.noarch 83 kB/s | 20 kB 00:00 2024-04-20T02:14:13.509 INFO:teuthology.orchestra.run.smithi117.stdout:(11/14): ceph-mgr-rook-18.2.2-1252.g15eecde2.el 35 kB/s | 49 kB 00:01 2024-04-20T02:14:13.751 INFO:teuthology.orchestra.run.smithi117.stdout:(12/14): python3-pyasn1-0.3.7-6.el8.noarch.rpm 523 kB/s | 126 kB 00:00 2024-04-20T02:14:13.776 INFO:teuthology.orchestra.run.smithi117.stdout:(13/14): python3-pyasn1-modules-0.3.7-6.el8.noa 293 kB/s | 110 kB 00:00 2024-04-20T02:14:13.809 INFO:teuthology.orchestra.run.smithi117.stdout:(14/14): python3-jsonpatch-1.21-2.el8.noarch.rp 74 kB/s | 27 kB 00:00 2024-04-20T02:14:13.811 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:14:13.812 INFO:teuthology.orchestra.run.smithi117.stdout:Total 998 kB/s | 2.0 MB 00:02 2024-04-20T02:14:13.890 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:14:13.906 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:14:13.906 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:14:13.988 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:14:13.996 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:14:14.355 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================== 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================== 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 49 k 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-20T02:14:14.357 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================== 2024-04-20T02:14:14.358 INFO:teuthology.orchestra.run.smithi171.stdout:Install 14 Packages 2024-04-20T02:14:14.359 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:14.359 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 2.0 M 2024-04-20T02:14:14.359 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 25 M 2024-04-20T02:14:14.359 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:14:14.534 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:14:14.741 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/14 2024-04-20T02:14:14.817 INFO:teuthology.orchestra.run.smithi171.stdout:(1/14): ceph-mgr-rook-18.2.2-1252.g15eecde2.el8 301 kB/s | 49 kB 00:00 2024-04-20T02:14:14.884 INFO:teuthology.orchestra.run.smithi171.stdout:(2/14): python3-certifi-2018.10.15-7.el8.noarch 71 kB/s | 16 kB 00:00 2024-04-20T02:14:14.909 INFO:teuthology.orchestra.run.smithi171.stdout:(3/14): python3-cachetools-3.1.1-4.el8.noarch.r 129 kB/s | 33 kB 00:00 2024-04-20T02:14:14.993 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/14 2024-04-20T02:14:15.051 INFO:teuthology.orchestra.run.smithi171.stdout:(4/14): python3-rsa-4.9-2.el8.noarch.rpm 453 kB/s | 64 kB 00:00 2024-04-20T02:14:15.165 INFO:teuthology.orchestra.run.smithi171.stdout:(5/14): python3-google-auth-1.1.1-10.el8.noarch 234 kB/s | 81 kB 00:00 2024-04-20T02:14:15.194 INFO:teuthology.orchestra.run.smithi171.stdout:(6/14): python3-websocket-client-0.56.0-5.el8.n 431 kB/s | 61 kB 00:00 2024-04-20T02:14:15.222 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/14 2024-04-20T02:14:15.236 INFO:teuthology.orchestra.run.smithi171.stdout:(7/14): python3-kubernetes-11.0.0-6.el8.noarch. 3.4 MB/s | 1.2 MB 00:00 2024-04-20T02:14:15.386 INFO:teuthology.orchestra.run.smithi171.stdout:(8/14): python3-jsonpointer-1.10-11.el8.noarch. 90 kB/s | 20 kB 00:00 2024-04-20T02:14:15.411 INFO:teuthology.orchestra.run.smithi171.stdout:(9/14): python3-pyasn1-modules-0.3.7-6.el8.noar 507 kB/s | 110 kB 00:00 2024-04-20T02:14:15.486 INFO:teuthology.orchestra.run.smithi171.stdout:(10/14): python3-jsonpatch-1.21-2.el8.noarch.rp 111 kB/s | 27 kB 00:00 2024-04-20T02:14:15.528 INFO:teuthology.orchestra.run.smithi171.stdout:(11/14): python3-pyasn1-0.3.7-6.el8.noarch.rpm 889 kB/s | 126 kB 00:00 2024-04-20T02:14:15.554 INFO:teuthology.orchestra.run.smithi171.stdout:(12/14): python3-jwt-1.6.1-2.el8.noarch.rpm 299 kB/s | 43 kB 00:00 2024-04-20T02:14:15.629 INFO:teuthology.orchestra.run.smithi171.stdout:(13/14): python3-oauthlib-2.1.0-1.el8.noarch.rp 1.1 MB/s | 155 kB 00:00 2024-04-20T02:14:15.679 INFO:teuthology.orchestra.run.smithi171.stdout:(14/14): python3-requests-oauthlib-1.0.0-1.el8. 284 kB/s | 43 kB 00:00 2024-04-20T02:14:15.682 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:14:15.682 INFO:teuthology.orchestra.run.smithi171.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-04-20T02:14:15.758 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:14:15.774 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:14:15.774 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:14:15.856 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:14:15.865 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:14:16.007 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/14 2024-04-20T02:14:16.211 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/14 2024-04-20T02:14:16.374 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:14:16.459 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 6/14 2024-04-20T02:14:16.603 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/14 2024-04-20T02:14:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 7/14 2024-04-20T02:14:16.805 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el8.noarch 2/14 2024-04-20T02:14:16.995 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/14 2024-04-20T02:14:17.003 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/14 2024-04-20T02:14:17.240 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 9/14 2024-04-20T02:14:17.247 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 4/14 2024-04-20T02:14:17.472 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 10/14 2024-04-20T02:14:17.490 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 5/14 2024-04-20T02:14:17.683 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 6/14 2024-04-20T02:14:17.747 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 11/14 2024-04-20T02:14:17.884 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 7/14 2024-04-20T02:14:18.030 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 8/14 2024-04-20T02:14:18.836 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 12/14 2024-04-20T02:14:19.084 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 13/14 2024-04-20T02:14:19.197 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 9/14 2024-04-20T02:14:19.298 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 14/14 2024-04-20T02:14:19.584 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 10/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 14/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 1/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/14 2024-04-20T02:14:19.632 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 8/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 9/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 10/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 12/14 2024-04-20T02:14:19.633 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 13/14 2024-04-20T02:14:19.843 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 11/14 2024-04-20T02:14:20.878 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 12/14 2024-04-20T02:14:21.104 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 13/14 2024-04-20T02:14:21.268 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 14/14 2024-04-20T02:14:21.553 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 14/14 2024-04-20T02:14:21.553 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 1/14 2024-04-20T02:14:21.553 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 6/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 8/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 9/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 11/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 12/14 2024-04-20T02:14:21.554 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 13/14 2024-04-20T02:14:29.059 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 14/14 2024-04-20T02:14:29.059 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:14:29.674 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-20T02:14:29.675 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-20T02:14:29.676 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-20T02:14:29.676 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:29.676 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:14:29.871 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-cephadm 2024-04-20T02:14:30.229 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:14:32.145 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-04-20T02:14:32.596 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 26 kB/s | 4.5 kB 00:00 2024-04-20T02:14:35.095 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:14:35.095 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================================== 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================================== 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 138 k 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================================== 2024-04-20T02:14:35.096 INFO:teuthology.orchestra.run.smithi117.stdout:Install 5 Packages 2024-04-20T02:14:35.097 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:35.097 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 6.0 M 2024-04-20T02:14:35.097 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 26 M 2024-04-20T02:14:35.097 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:14:35.945 INFO:teuthology.orchestra.run.smithi117.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 117 kB/s | 60 kB 00:00 2024-04-20T02:14:35.970 INFO:teuthology.orchestra.run.smithi117.stdout:(2/5): ceph-mgr-cephadm-18.2.2-1252.g15eecde2.e 256 kB/s | 138 kB 00:00 2024-04-20T02:14:36.204 INFO:teuthology.orchestra.run.smithi117.stdout:(3/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 616 kB/s | 476 kB 00:00 2024-04-20T02:14:36.304 INFO:teuthology.orchestra.run.smithi117.stdout:(4/5): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2024-04-20T02:14:36.338 INFO:teuthology.orchestra.run.smithi117.stdout:(5/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.5 MB/s | 538 kB 00:00 2024-04-20T02:14:36.340 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:14:36.340 INFO:teuthology.orchestra.run.smithi117.stdout:Total 4.8 MB/s | 6.0 MB 00:01 2024-04-20T02:14:36.394 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:14:36.406 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:14:36.406 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:14:36.466 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 14/14 2024-04-20T02:14:36.466 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:14:36.497 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:14:36.503 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-20T02:14:37.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:37.032 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:14:37.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-mgr-cephadm 2024-04-20T02:14:37.458 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:14:37.581 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:14:37.831 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2024-04-20T02:14:38.087 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2024-04-20T02:14:38.443 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2024-04-20T02:14:38.753 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-20T02:14:38.985 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 5/5 2024-04-20T02:14:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 5/5 2024-04-20T02:14:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/5 2024-04-20T02:14:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-20T02:14:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2024-04-20T02:14:39.237 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 4/5 2024-04-20T02:14:39.449 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-04-20T02:14:40.136 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 30 kB/s | 4.1 kB 00:00 2024-04-20T02:14:42.561 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================================== 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================================== 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 138 k 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-20T02:14:42.562 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================================== 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout:Install 5 Packages 2024-04-20T02:14:42.563 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:42.564 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 6.0 M 2024-04-20T02:14:42.564 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 26 M 2024-04-20T02:14:42.564 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:14:43.224 INFO:teuthology.orchestra.run.smithi171.stdout:(1/5): python3-natsort-7.1.1-2.el8.noarch.rpm 123 kB/s | 60 kB 00:00 2024-04-20T02:14:43.466 INFO:teuthology.orchestra.run.smithi171.stdout:(2/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 649 kB/s | 476 kB 00:00 2024-04-20T02:14:43.549 INFO:teuthology.orchestra.run.smithi171.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2024-04-20T02:14:43.699 INFO:teuthology.orchestra.run.smithi171.stdout:(4/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.3 MB/s | 538 kB 00:00 2024-04-20T02:14:43.716 INFO:teuthology.orchestra.run.smithi171.stdout:(5/5): ceph-mgr-cephadm-18.2.2-1252.g15eecde2.e 140 kB/s | 138 kB 00:00 2024-04-20T02:14:43.718 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:14:43.718 INFO:teuthology.orchestra.run.smithi171.stdout:Total 5.2 MB/s | 6.0 MB 00:01 2024-04-20T02:14:43.774 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:14:43.786 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:14:43.787 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:14:43.875 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:14:43.884 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:14:44.886 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:14:45.228 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2024-04-20T02:14:45.483 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2024-04-20T02:14:45.770 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2024-04-20T02:14:46.072 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2024-04-20T02:14:46.239 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 5/5 2024-04-20T02:14:46.512 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 5/5 2024-04-20T02:14:46.513 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 1/5 2024-04-20T02:14:46.513 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2024-04-20T02:14:46.513 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2024-04-20T02:14:46.513 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 4/5 2024-04-20T02:14:53.226 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 5/5 2024-04-20T02:14:53.226 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-20T02:14:53.795 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:53.796 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:14:53.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-fuse 2024-04-20T02:14:54.307 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:14:56.328 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2024-04-20T02:14:56.740 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-04-20T02:14:58.806 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 5/5 2024-04-20T02:14:58.806 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:14:59.288 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:14:59.289 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:14:59.289 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:14:59.289 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:14:59.289 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 859 k 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout:Install 2 Packages 2024-04-20T02:14:59.290 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:14:59.291 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 942 k 2024-04-20T02:14:59.291 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 3.0 M 2024-04-20T02:14:59.291 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:14:59.369 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:59.369 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:14:59.369 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:14:59.369 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-20T02:14:59.369 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-20T02:14:59.369 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-20T02:14:59.370 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-20T02:14:59.370 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:14:59.370 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:14:59.488 INFO:teuthology.orchestra.run.smithi117.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 421 kB/s | 83 kB 00:00 2024-04-20T02:14:59.546 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-fuse 2024-04-20T02:14:59.906 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:00.230 INFO:teuthology.orchestra.run.smithi117.stdout:(2/2): ceph-fuse-18.2.2-1252.g15eecde2.el8.x86_ 914 kB/s | 859 kB 00:00 2024-04-20T02:15:00.231 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:00.231 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.0 MB/s | 942 kB 00:00 2024-04-20T02:15:00.243 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:15:00.265 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:15:00.265 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:15:00.351 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:15:00.359 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:15:00.523 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:15:00.763 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-04-20T02:15:00.955 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 2/2 2024-04-20T02:15:01.340 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 2/2 2024-04-20T02:15:01.340 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/2 2024-04-20T02:15:01.822 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 31 kB/s | 4.5 kB 00:00 2024-04-20T02:15:02.490 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 34 kB/s | 4.1 kB 00:00 2024-04-20T02:15:04.785 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout: x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 859 k 2024-04-20T02:15:04.786 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout:Install 2 Packages 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 942 k 2024-04-20T02:15:04.787 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 3.0 M 2024-04-20T02:15:04.788 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:15:04.960 INFO:teuthology.orchestra.run.smithi171.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 481 kB/s | 83 kB 00:00 2024-04-20T02:15:05.811 INFO:teuthology.orchestra.run.smithi171.stdout:(2/2): ceph-fuse-18.2.2-1252.g15eecde2.el8.x86_ 839 kB/s | 859 kB 00:01 2024-04-20T02:15:05.811 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:05.812 INFO:teuthology.orchestra.run.smithi171.stdout:Total 919 kB/s | 942 kB 00:01 2024-04-20T02:15:05.824 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:15:05.847 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:15:05.847 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:15:05.937 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:15:05.946 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:15:06.122 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:15:06.361 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-04-20T02:15:06.544 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 2/2 2024-04-20T02:15:06.928 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 2/2 2024-04-20T02:15:06.928 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/2 2024-04-20T02:15:12.223 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-04-20T02:15:12.224 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:15:12.792 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:12.792 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:15:12.792 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-04-20T02:15:12.792 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:12.792 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:15:12.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-volume 2024-04-20T02:15:13.337 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:15.182 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 16 kB/s | 4.1 kB 00:00 2024-04-20T02:15:15.629 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 28 kB/s | 4.5 kB 00:00 2024-04-20T02:15:17.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-04-20T02:15:17.629 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:15:18.196 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:15:18.196 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2024-04-20T02:15:18.196 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-20T02:15:18.196 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2024-04-20T02:15:18.196 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 263 k 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================================== 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout:Install 2 Packages 2024-04-20T02:15:18.197 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:18.198 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 311 k 2024-04-20T02:15:18.198 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 1.4 M 2024-04-20T02:15:18.198 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:15:18.216 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:18.216 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:15:18.216 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-04-20T02:15:18.216 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:18.216 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:15:18.376 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-volume 2024-04-20T02:15:18.418 INFO:teuthology.orchestra.run.smithi117.stdout:(1/2): ceph-volume-18.2.2-1252.g15eecde2.el8.no 1.2 MB/s | 263 kB 00:00 2024-04-20T02:15:18.485 INFO:teuthology.orchestra.run.smithi117.stdout:(2/2): python3-packaging-16.8-9.el8.noarch.rpm 168 kB/s | 48 kB 00:00 2024-04-20T02:15:18.486 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:18.486 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.1 MB/s | 311 kB 00:00 2024-04-20T02:15:18.496 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:15:18.508 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:15:18.508 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:15:18.546 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:15:18.554 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:15:18.738 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:18.751 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:15:19.098 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-16.8-9.el8.noarch 1/2 2024-04-20T02:15:19.618 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 2/2 2024-04-20T02:15:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 2/2 2024-04-20T02:15:20.009 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 1/2 2024-04-20T02:15:20.386 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 kB/s | 4.5 kB 00:00 2024-04-20T02:15:21.024 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 kB/s | 4.1 kB 00:00 2024-04-20T02:15:23.327 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:15:23.328 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================== 2024-04-20T02:15:23.328 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-20T02:15:23.328 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================== 2024-04-20T02:15:23.328 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:15:23.328 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:18.2.2-1252.g15eecde2.el8 ceph-noarch 263 k 2024-04-20T02:15:23.328 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-20T02:15:23.329 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-20T02:15:23.329 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:23.329 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:15:23.329 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================================== 2024-04-20T02:15:23.329 INFO:teuthology.orchestra.run.smithi171.stdout:Install 2 Packages 2024-04-20T02:15:23.329 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:23.330 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 311 k 2024-04-20T02:15:23.330 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 1.4 M 2024-04-20T02:15:23.330 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:15:23.542 INFO:teuthology.orchestra.run.smithi171.stdout:(1/2): python3-packaging-16.8-9.el8.noarch.rpm 227 kB/s | 48 kB 00:00 2024-04-20T02:15:23.708 INFO:teuthology.orchestra.run.smithi171.stdout:(2/2): ceph-volume-18.2.2-1252.g15eecde2.el8.no 695 kB/s | 263 kB 00:00 2024-04-20T02:15:23.708 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:23.709 INFO:teuthology.orchestra.run.smithi171.stdout:Total 820 kB/s | 311 kB 00:00 2024-04-20T02:15:23.720 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:15:23.732 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:15:23.732 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:15:23.769 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:15:23.778 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:15:23.957 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:15:24.289 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-16.8-9.el8.noarch 1/2 2024-04-20T02:15:24.558 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 2/2 2024-04-20T02:15:24.958 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 2/2 2024-04-20T02:15:24.958 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 1/2 2024-04-20T02:15:31.486 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 2/2 2024-04-20T02:15:31.486 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:15:32.049 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:32.049 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:15:32.049 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:15:32.050 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-20T02:15:32.050 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:32.050 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:15:32.234 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados-devel 2024-04-20T02:15:32.595 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:34.493 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 kB/s | 4.1 kB 00:00 2024-04-20T02:15:34.869 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 kB/s | 4.5 kB 00:00 2024-04-20T02:15:34.894 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 2/2 2024-04-20T02:15:34.894 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:15:35.449 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:35.449 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:15:35.449 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:18.2.2-1252.g15eecde2.el8.noarch 2024-04-20T02:15:35.449 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-20T02:15:35.449 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:35.449 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:15:35.596 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librados-devel 2024-04-20T02:15:35.962 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:37.494 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 139 k 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:15:37.495 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:15:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:37.496 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 139 k 2024-04-20T02:15:37.496 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 513 k 2024-04-20T02:15:37.496 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:15:37.914 INFO:teuthology.orchestra.run.smithi117.stdout:librados-devel-18.2.2-1252.g15eecde2.el8.x86_64 333 kB/s | 139 kB 00:00 2024-04-20T02:15:37.915 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:37.915 INFO:teuthology.orchestra.run.smithi117.stdout:Total 332 kB/s | 139 kB 00:00 2024-04-20T02:15:37.915 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:15:37.920 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:15:37.921 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:15:37.937 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 kB/s | 4.5 kB 00:00 2024-04-20T02:15:37.977 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:15:37.986 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:15:38.141 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:15:38.364 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:38.637 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:38.654 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-04-20T02:15:40.966 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:15:40.966 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repo Size 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 139 k 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:15:40.967 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:40.968 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 139 k 2024-04-20T02:15:40.968 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 513 k 2024-04-20T02:15:40.968 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:15:41.157 INFO:teuthology.orchestra.run.smithi171.stdout:librados-devel-18.2.2-1252.g15eecde2.el8.x86_64 738 kB/s | 139 kB 00:00 2024-04-20T02:15:41.157 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:41.157 INFO:teuthology.orchestra.run.smithi171.stdout:Total 733 kB/s | 139 kB 00:00 2024-04-20T02:15:41.158 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:15:41.164 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:15:41.164 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:15:41.220 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:15:41.229 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:15:41.354 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:15:41.540 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:41.797 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:47.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:47.123 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:15:47.681 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:15:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:15:47.682 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:15:47.833 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs2 2024-04-20T02:15:48.194 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:50.079 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-04-20T02:15:50.454 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 kB/s | 4.5 kB 00:00 2024-04-20T02:15:52.143 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:52.143 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:15:52.704 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:52.704 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:15:52.704 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:15:52.704 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:15:52.704 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:15:52.768 INFO:teuthology.orchestra.run.smithi117.stdout:Package libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:15:52.852 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install libcephfs2 2024-04-20T02:15:52.953 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:15:52.954 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:15:52.954 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:15:53.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs-devel 2024-04-20T02:15:53.216 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:53.454 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:54.920 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 kB/s | 4.5 kB 00:00 2024-04-20T02:15:55.263 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 kB/s | 4.1 kB 00:00 2024-04-20T02:15:55.602 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 31 kB/s | 4.1 kB 00:00 2024-04-20T02:15:55.686 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-04-20T02:15:57.835 INFO:teuthology.orchestra.run.smithi171.stdout:Package libcephfs2-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:15:58.028 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:15:58.029 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:15:58.029 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:15:58.181 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install libcephfs-devel 2024-04-20T02:15:58.214 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 31 k 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:58.215 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:15:58.216 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:15:58.216 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:15:58.216 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:15:58.216 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 31 k 2024-04-20T02:15:58.216 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 139 k 2024-04-20T02:15:58.216 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:15:58.369 INFO:teuthology.orchestra.run.smithi117.stdout:libcephfs-devel-18.2.2-1252.g15eecde2.el8.x86_6 202 kB/s | 31 kB 00:00 2024-04-20T02:15:58.370 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:15:58.370 INFO:teuthology.orchestra.run.smithi117.stdout:Total 201 kB/s | 31 kB 00:00 2024-04-20T02:15:58.370 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:15:58.374 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:15:58.374 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:15:58.386 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:15:58.395 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:15:58.456 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:15:58.540 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:15:58.683 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:15:58.925 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:00.146 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-04-20T02:16:00.866 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2024-04-20T02:16:03.162 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repo Size 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 31 k 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:16:03.163 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:16:03.164 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 31 k 2024-04-20T02:16:03.164 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 139 k 2024-04-20T02:16:03.164 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:16:03.319 INFO:teuthology.orchestra.run.smithi171.stdout:libcephfs-devel-18.2.2-1252.g15eecde2.el8.x86_6 200 kB/s | 31 kB 00:00 2024-04-20T02:16:03.322 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:16:03.322 INFO:teuthology.orchestra.run.smithi171.stdout:Total 198 kB/s | 31 kB 00:00 2024-04-20T02:16:03.322 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:16:03.324 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:16:03.324 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:16:03.337 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:16:03.346 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:16:03.436 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:16:03.600 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:03.832 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:11.069 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:11.069 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:16:11.640 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:16:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:16:11.641 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:16:11.641 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:16:11.641 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:11.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados2 2024-04-20T02:16:12.158 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:13.992 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 31 kB/s | 4.1 kB 00:00 2024-04-20T02:16:14.426 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 kB/s | 4.5 kB 00:00 2024-04-20T02:16:14.902 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:14.903 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:16:15.457 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:16:15.457 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:16:15.457 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:16:15.457 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:16:15.457 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:15.615 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librados2 2024-04-20T02:16:15.976 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:16.774 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:16.961 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:16.962 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:16:16.962 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:17.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librbd1 2024-04-20T02:16:17.473 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:17.712 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 kB/s | 4.5 kB 00:00 2024-04-20T02:16:18.296 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 102 kB/s | 4.1 kB 00:00 2024-04-20T02:16:19.259 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 39 kB/s | 4.1 kB 00:00 2024-04-20T02:16:19.659 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 kB/s | 4.5 kB 00:00 2024-04-20T02:16:20.401 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:20.589 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:20.590 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:16:20.590 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:20.745 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install librbd1 2024-04-20T02:16:21.105 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:21.975 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:22.163 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:22.164 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:16:22.164 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:22.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rados 2024-04-20T02:16:22.653 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:22.908 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 kB/s | 4.5 kB 00:00 2024-04-20T02:16:23.563 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 4.1 kB 00:00 2024-04-20T02:16:24.520 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 35 kB/s | 4.1 kB 00:00 2024-04-20T02:16:24.956 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 kB/s | 4.5 kB 00:00 2024-04-20T02:16:25.708 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:25.898 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:25.900 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:16:25.900 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:26.042 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-rados 2024-04-20T02:16:26.401 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:27.283 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:27.470 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:27.471 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:16:27.471 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:27.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rgw 2024-04-20T02:16:27.966 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:28.205 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-04-20T02:16:28.901 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 27 kB/s | 4.1 kB 00:00 2024-04-20T02:16:29.872 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 kB/s | 4.1 kB 00:00 2024-04-20T02:16:30.272 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 kB/s | 4.5 kB 00:00 2024-04-20T02:16:31.137 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-rados-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:31.329 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:31.330 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:16:31.330 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:31.484 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-rgw 2024-04-20T02:16:31.845 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:32.609 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:32.799 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:32.800 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:16:32.800 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:32.944 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-cephfs 2024-04-20T02:16:33.301 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:33.621 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-04-20T02:16:34.325 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 25 kB/s | 4.1 kB 00:00 2024-04-20T02:16:35.143 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 kB/s | 4.1 kB 00:00 2024-04-20T02:16:35.546 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-04-20T02:16:36.434 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-rgw-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:36.627 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:36.629 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:16:36.629 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:36.774 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-cephfs 2024-04-20T02:16:37.137 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:37.859 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:38.049 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:38.050 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:16:38.051 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:38.181 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rbd 2024-04-20T02:16:38.540 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:38.946 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-04-20T02:16:39.601 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 kB/s | 4.1 kB 00:00 2024-04-20T02:16:40.374 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 28 kB/s | 4.1 kB 00:00 2024-04-20T02:16:40.840 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 23 kB/s | 4.5 kB 00:00 2024-04-20T02:16:41.828 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-cephfs-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:42.024 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:42.026 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:16:42.026 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:42.168 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install python3-rbd 2024-04-20T02:16:42.529 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:43.149 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:43.338 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:43.339 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-20T02:16:43.339 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:16:43.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-fuse 2024-04-20T02:16:43.855 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:44.255 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-04-20T02:16:44.911 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 36 kB/s | 4.1 kB 00:00 2024-04-20T02:16:45.832 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 kB/s | 4.1 kB 00:00 2024-04-20T02:16:46.214 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 kB/s | 4.5 kB 00:00 2024-04-20T02:16:47.009 INFO:teuthology.orchestra.run.smithi171.stdout:Package python3-rbd-2:18.2.2-1252.g15eecde2.el8.x86_64 is already installed. 2024-04-20T02:16:47.199 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:47.202 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-04-20T02:16:47.202 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:16:47.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install rbd-fuse 2024-04-20T02:16:47.699 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:16:48.725 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 95 k 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:16:48.726 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:16:48.727 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:16:48.727 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:16:48.727 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:16:48.727 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 95 k 2024-04-20T02:16:48.727 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 280 k 2024-04-20T02:16:48.727 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:16:49.038 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-fuse-18.2.2-1252.g15eecde2.el8.x86_64.rpm 306 kB/s | 95 kB 00:00 2024-04-20T02:16:49.038 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:16:49.038 INFO:teuthology.orchestra.run.smithi117.stdout:Total 305 kB/s | 95 kB 00:00 2024-04-20T02:16:49.039 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:16:49.049 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:16:49.049 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:16:49.105 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:16:49.113 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:16:49.238 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:16:49.413 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:49.686 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:49.758 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-04-20T02:16:50.484 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 23 kB/s | 4.1 kB 00:00 2024-04-20T02:16:52.768 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 95 k 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:16:52.769 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:16:52.770 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:16:52.770 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:16:52.770 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 95 k 2024-04-20T02:16:52.770 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 280 k 2024-04-20T02:16:52.770 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:16:53.058 INFO:teuthology.orchestra.run.smithi171.stdout:rbd-fuse-18.2.2-1252.g15eecde2.el8.x86_64.rpm 332 kB/s | 95 kB 00:00 2024-04-20T02:16:53.058 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:16:53.058 INFO:teuthology.orchestra.run.smithi171.stdout:Total 330 kB/s | 95 kB 00:00 2024-04-20T02:16:53.058 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:16:53.069 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:16:53.069 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:16:53.125 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:16:53.133 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:16:53.241 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:16:53.416 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:16:53.691 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:00.695 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:00.695 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:17:01.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:01.254 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:17:01.254 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:17:01.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:01.255 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:17:01.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-mirror 2024-04-20T02:17:01.779 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:17:03.613 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-04-20T02:17:04.016 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 kB/s | 4.5 kB 00:00 2024-04-20T02:17:06.549 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:17:06.549 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:17:06.549 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 3.5 M 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:17:06.550 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:06.551 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 3.5 M 2024-04-20T02:17:06.551 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 16 M 2024-04-20T02:17:06.551 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:17:07.089 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-mirror-18.2.2-1252.g15eecde2.el8.x86_64.rpm 6.4 MB/s | 3.5 MB 00:00 2024-04-20T02:17:07.089 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:17:07.090 INFO:teuthology.orchestra.run.smithi117.stdout:Total 6.4 MB/s | 3.5 MB 00:00 2024-04-20T02:17:07.090 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:17:07.094 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:07.095 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:17:07.102 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:17:07.103 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:17:07.171 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:17:07.180 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:17:07.647 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:07.648 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:17:07.648 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:17:07.648 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:07.648 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:17:07.670 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:17:07.811 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install rbd-mirror 2024-04-20T02:17:07.861 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:08.173 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:17:08.268 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:09.928 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 kB/s | 4.5 kB 00:00 2024-04-20T02:17:10.592 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 35 kB/s | 4.1 kB 00:00 2024-04-20T02:17:12.890 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repo Size 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 3.5 M 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:12.891 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:17:12.892 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:17:12.892 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:17:12.892 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:12.892 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 3.5 M 2024-04-20T02:17:12.892 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 16 M 2024-04-20T02:17:12.892 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:17:13.426 INFO:teuthology.orchestra.run.smithi171.stdout:rbd-mirror-18.2.2-1252.g15eecde2.el8.x86_64.rpm 6.5 MB/s | 3.5 MB 00:00 2024-04-20T02:17:13.427 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:17:13.427 INFO:teuthology.orchestra.run.smithi171.stdout:Total 6.4 MB/s | 3.5 MB 00:00 2024-04-20T02:17:13.428 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:17:13.440 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:17:13.440 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:17:13.508 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:17:13.517 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:17:13.962 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:17:14.132 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:14.528 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:22.640 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:22.640 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:17:23.196 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:23.196 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:17:23.196 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:17:23.197 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:23.197 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:17:23.361 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-nbd 2024-04-20T02:17:23.722 INFO:teuthology.orchestra.run.smithi117.stdout:Updating Subscription Management repositories. 2024-04-20T02:17:25.718 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 27 kB/s | 4.1 kB 00:00 2024-04-20T02:17:25.843 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:25.843 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:17:26.118 INFO:teuthology.orchestra.run.smithi117.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 kB/s | 4.5 kB 00:00 2024-04-20T02:17:26.418 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:26.418 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:17:26.418 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:17:26.418 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:26.418 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:17:26.612 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install rbd-nbd 2024-04-20T02:17:26.973 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-04-20T02:17:28.628 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 182 k 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-20T02:17:28.629 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:28.630 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 182 k 2024-04-20T02:17:28.630 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 572 k 2024-04-20T02:17:28.630 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-20T02:17:28.832 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-nbd-18.2.2-1252.g15eecde2.el8.x86_64.rpm 900 kB/s | 182 kB 00:00 2024-04-20T02:17:28.833 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:17:28.833 INFO:teuthology.orchestra.run.smithi117.stdout:Total 895 kB/s | 182 kB 00:00 2024-04-20T02:17:28.833 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-20T02:17:28.844 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-20T02:17:28.844 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-20T02:17:28.900 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-20T02:17:28.908 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-20T02:17:28.919 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 kB/s | 4.5 kB 00:00 2024-04-20T02:17:29.052 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-20T02:17:29.213 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:29.500 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:29.565 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 kB/s | 4.1 kB 00:00 2024-04-20T02:17:31.852 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-20T02:17:31.852 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:18.2.2-1252.g15eecde2.el8 ceph 182 k 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:Install 1 Package 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 182 k 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 572 k 2024-04-20T02:17:31.853 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-20T02:17:32.530 INFO:teuthology.orchestra.run.smithi171.stdout:rbd-nbd-18.2.2-1252.g15eecde2.el8.x86_64.rpm 268 kB/s | 182 kB 00:00 2024-04-20T02:17:32.531 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-20T02:17:32.531 INFO:teuthology.orchestra.run.smithi171.stdout:Total 268 kB/s | 182 kB 00:00 2024-04-20T02:17:32.531 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-20T02:17:32.543 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-20T02:17:32.543 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-20T02:17:32.601 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-20T02:17:32.610 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-20T02:17:32.728 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-20T02:17:32.877 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:33.149 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:40.865 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:40.865 INFO:teuthology.orchestra.run.smithi117.stdout:Installed products updated. 2024-04-20T02:17:41.426 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:41.427 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-20T02:17:41.427 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:17:41.427 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:41.427 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-20T02:17:41.583 DEBUG:teuthology.parallel:result is None 2024-04-20T02:17:47.256 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 1/1 2024-04-20T02:17:47.257 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-04-20T02:17:47.811 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:47.812 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-20T02:17:47.812 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:18.2.2-1252.g15eecde2.el8.x86_64 2024-04-20T02:17:47.812 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:47.812 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-20T02:17:47.975 DEBUG:teuthology.parallel:result is None 2024-04-20T02:17:47.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=15eecde2bab9803889d929c7e423d07970d8cbed 2024-04-20T02:17:48.198 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T02:17:48.226 INFO:teuthology.orchestra.run.smithi117.stdout:18.2.2-1252.g15eecde2.el8 2024-04-20T02:17:48.227 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1252.g15eecde2.el8 2024-04-20T02:17:48.227 INFO:teuthology.task.install:The correct ceph version 18.2.2-1252.g15eecde2 is installed. 2024-04-20T02:17:48.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=15eecde2bab9803889d929c7e423d07970d8cbed 2024-04-20T02:17:48.376 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T02:17:48.399 INFO:teuthology.orchestra.run.smithi171.stdout:18.2.2-1252.g15eecde2.el8 2024-04-20T02:17:48.400 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1252.g15eecde2.el8 2024-04-20T02:17:48.400 INFO:teuthology.task.install:The correct ceph version 18.2.2-1252.g15eecde2 is installed. 2024-04-20T02:17:48.401 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-20T02:17:48.402 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:48.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T02:17:48.449 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:48.449 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T02:17:48.490 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-20T02:17:48.490 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:48.490 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T02:17:48.521 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T02:17:48.590 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:48.590 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T02:17:48.618 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T02:17:48.685 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-20T02:17:48.685 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:48.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T02:17:48.715 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T02:17:48.784 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:48.784 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T02:17:48.810 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T02:17:48.877 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-20T02:17:48.877 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:48.877 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T02:17:48.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T02:17:48.973 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:48.974 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T02:17:49.000 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T02:17:49.067 INFO:teuthology.run_tasks:Running task ceph... 2024-04-20T02:17:49.151 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-20T02:17:49.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-04-20T02:17:49.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-04-20T02:17:49.180 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-20T02:17:49.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-20T02:17:49.221 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-20T02:17:49.248 INFO:tasks.ceph:Creating extra log directories... 2024-04-20T02:17:49.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-20T02:17:49.289 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-20T02:17:49.323 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-20T02:17:49.323 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-20T02:17:49.323 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202', 'branch': 'wip-yuri7-testing-2024-04-18-1351-reef', 'description': 'rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7664202', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2024-04-18-1351-reef'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2024-04-18-1351-reef', 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'], ['osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 6867, 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri7-testing-2024-04-18-1351-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_15eecde2bab9803889d929c7e423d07970d8cbed/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '15eecde2bab9803889d929c7e423d07970d8cbed', 'targets': {'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZNIdUmQNy2P5RbxBxa/gw7UTvoWRj4MzS+oipwtFH1P9olpb1M91lDtfcqzPvPv6bE0cUy5O5lnfRuIJ3HbwE=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAD6/4gC+PW3zli9Ira+FTiwB/Njx+RA7VqNakt7qzqQGMIOg3UvWBLheHQA19HPyYcJB4hh6KJZdtZX2N2q/tc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '15eecde2bab9803889d929c7e423d07970d8cbed', 'cluster': 'ceph'}}, {'full_sequential': [{'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33', 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33', 'sudo ceph osd pool create test 16 16', 'sudo ceph osd pool set test size 3', 'sudo ceph pg dump pgs --format=json-pretty']}}, {'radosbench': {'clients': ['client.0'], 'create_pool': False, 'objectsize': 1048576, 'pool': 'test', 'time': 360, 'type': 'rand'}}, {'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0', 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0']}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-20_01:10:46', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-20T02:17:49.324 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-20T02:17:49.357 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-20T02:17:49.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-04-20T02:17:49.414 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-04-20T02:17:49.440 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:49.440 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T02:17:49.495 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T02:17:49.496 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 179715 Links: 1 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-20 02:17:08.041350894 +0000 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-20 02:08:34.867319945 +0000 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-20 02:08:34.867319945 +0000 2024-04-20T02:17:49.553 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-04-20T02:17:49.553 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T02:17:49.618 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-20T02:17:49.618 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-20T02:17:49.618 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000230795 s, 2.2 MB/s 2024-04-20T02:17:49.619 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T02:17:49.677 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-04-20T02:17:49.734 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 178030 Links: 1 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-20 02:17:08.041350894 +0000 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-20 02:08:35.222313028 +0000 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-20 02:08:35.222313028 +0000 2024-04-20T02:17:49.735 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-04-20T02:17:49.735 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T02:17:49.799 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-20T02:17:49.800 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-20T02:17:49.800 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00025277 s, 2.0 MB/s 2024-04-20T02:17:49.801 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T02:17:49.857 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 179858 Links: 1 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-20 02:17:08.041350894 +0000 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-20 02:08:35.557306500 +0000 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-20 02:08:35.557306500 +0000 2024-04-20T02:17:49.915 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-04-20T02:17:49.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T02:17:49.980 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-20T02:17:49.980 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-20T02:17:49.980 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.0001808 s, 2.8 MB/s 2024-04-20T02:17:49.981 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T02:17:50.039 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-04-20T02:17:50.096 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 179930 Links: 1 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-20 02:17:08.041350894 +0000 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-20 02:08:35.897299875 +0000 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-20 02:08:35.897299875 +0000 2024-04-20T02:17:50.097 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-04-20T02:17:50.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T02:17:50.161 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-20T02:17:50.161 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-20T02:17:50.161 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.0002285 s, 2.2 MB/s 2024-04-20T02:17:50.162 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T02:17:50.220 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-20T02:17:50.220 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:50.220 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T02:17:50.238 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T02:17:50.239 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-04-20T02:17:50.298 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 182434 Links: 1 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-20 02:17:14.293007046 +0000 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-20 02:08:28.087081810 +0000 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-20 02:08:28.087081810 +0000 2024-04-20T02:17:50.299 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-20T02:17:50.299 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T02:17:50.368 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-20T02:17:50.368 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-20T02:17:50.368 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000271181 s, 1.9 MB/s 2024-04-20T02:17:50.368 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T02:17:50.427 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 181481 Links: 1 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-20 02:17:14.293007046 +0000 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-20 02:08:28.450081493 +0000 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-20 02:08:28.450081493 +0000 2024-04-20T02:17:50.488 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-20T02:17:50.489 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T02:17:50.555 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-20T02:17:50.555 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-20T02:17:50.556 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000248918 s, 2.1 MB/s 2024-04-20T02:17:50.557 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T02:17:50.616 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-04-20T02:17:50.674 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T02:17:50.674 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:50.674 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 182548 Links: 1 2024-04-20T02:17:50.674 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:50.675 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:50.675 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-20 02:17:14.293007046 +0000 2024-04-20T02:17:50.675 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-20 02:08:28.821081169 +0000 2024-04-20T02:17:50.675 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-20 02:08:28.821081169 +0000 2024-04-20T02:17:50.675 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-20T02:17:50.675 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T02:17:50.740 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-20T02:17:50.740 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-20T02:17:50.741 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00016928 s, 3.0 MB/s 2024-04-20T02:17:50.742 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T02:17:50.800 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 181535 Links: 1 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-20 02:17:14.294007045 +0000 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-20 02:08:29.176080858 +0000 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-20 02:08:29.176080858 +0000 2024-04-20T02:17:50.858 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-20T02:17:50.859 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T02:17:50.924 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-20T02:17:50.924 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-20T02:17:50.924 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00024392 s, 2.1 MB/s 2024-04-20T02:17:50.925 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T02:17:50.983 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-20T02:17:50.983 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-20T02:17:50.983 INFO:tasks.ceph:Generating config... 2024-04-20T02:17:50.984 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-04-20T02:17:50.984 INFO:tasks.ceph:[global] ms bind msgr1 = False 2024-04-20T02:17:50.984 INFO:tasks.ceph:[global] ms bind msgr2 = True 2024-04-20T02:17:50.984 INFO:tasks.ceph:[global] ms type = async 2024-04-20T02:17:50.984 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-20T02:17:50.984 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-20T02:17:50.984 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-20T02:17:50.984 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-20T02:17:50.984 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-20T02:17:50.984 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-04-20T02:17:50.984 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-04-20T02:17:50.985 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-20T02:17:50.986 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-04-20T02:17:50.986 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-04-20T02:17:50.986 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-20T02:17:50.986 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-04-20T02:17:50.986 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-04-20T02:17:50.986 INFO:tasks.ceph:Setting up mon.a... 2024-04-20T02:17:50.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-20T02:17:51.050 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.keyring 2024-04-20T02:17:51.053 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-20T02:17:51.102 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T02:17:51.129 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.117')] 2024-04-20T02:17:51.129 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.117', 'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2024-04-20T02:17:51.130 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:51.130 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-20T02:17:51.186 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.117 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:17:51.268 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: generated fsid be7bb238-dfe1-4609-b2f6-7166cd58fb18 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:setting min_mon_release = pacific 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 0 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:fsid be7bb238-dfe1-4609-b2f6-7166cd58fb18 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:last_changed 2024-04-20T02:17:51.270410+0000 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-20T02:17:51.270410+0000 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:min_mon_release 16 (pacific) 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:election_strategy: 3 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.a 2024-04-20T02:17:51.269 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-20T02:17:51.270 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-20T02:17:51.327 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID be7bb238-dfe1-4609-b2f6-7166cd58fb18... 2024-04-20T02:17:51.328 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-20T02:17:51.370 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-20T02:17:51.413 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-04-20T02:17:51.413 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-04-20T02:17:51.413 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-20T02:17:51.413 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-04-20T02:17:51.413 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.413 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-04-20T02:17:51.414 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-20T02:17:51.415 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-04-20T02:17:51.416 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = 172.21.15.117 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: mon election default strategy = 3 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: ms bind msgr1 = False 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: ms bind msgr2 = True 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: ms type = async 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = be7bb238-dfe1-4609-b2f6-7166cd58fb18 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-04-20T02:17:51.417 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.418 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore compression algorithm = zstd 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore compression mode = aggressive 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore zero block detection = True 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-04-20T02:17:51.419 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify cached snaps = True 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify missing on start = True 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock override recovery settings = True 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd op queue = debug_random 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: osd op queue cut off = debug_random 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-04-20T02:17:51.420 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-04-20T02:17:51.421 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: mon scrub interval = 300 2024-04-20T02:17:51.422 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-04-20T02:17:51.423 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.424 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-04-20T02:17:51.425 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-04-20T02:17:51.426 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = 172.21.15.117 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: mon election default strategy = 3 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: ms bind msgr1 = False 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: ms bind msgr2 = True 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: ms type = async 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = be7bb238-dfe1-4609-b2f6-7166cd58fb18 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-04-20T02:17:51.427 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-04-20T02:17:51.428 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression algorithm = zstd 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression mode = aggressive 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore zero block detection = True 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 20 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 20 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 10 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-04-20T02:17:51.429 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify cached snaps = True 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify missing on start = True 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock override recovery settings = True 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd op queue = debug_random 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: osd op queue cut off = debug_random 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-20T02:17:51.430 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.431 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: mon scrub interval = 300 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-04-20T02:17:51.432 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-04-20T02:17:51.433 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-04-20T02:17:51.433 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-20T02:17:51.433 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-20T02:17:51.433 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-04-20T02:17:51.434 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-20T02:17:51.434 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-20T02:17:51.532 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-20T02:17:51.532 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:51.532 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-20T02:17:51.549 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:51.549 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-20T02:17:51.606 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:17:51.606 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:51.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-20T02:17:51.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T02:17:51.683 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:17:51.683 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:17:51.740 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:17:51.740 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:51.740 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-20T02:17:51.740 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T02:17:51.779 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:17:51.779 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:17:51.837 INFO:tasks.ceph:Setting up mon nodes... 2024-04-20T02:17:51.837 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-20T02:17:51.837 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-20T02:17:51.890 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-20T02:17:51.893 INFO:tasks.ceph:Setting up mds nodes... 2024-04-20T02:17:51.893 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-20T02:17:51.893 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-20T02:17:51.941 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-20T02:17:51.955 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-20T02:17:51.955 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-20T02:17:51.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-20T02:17:51.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-20T02:17:51.982 INFO:tasks.ceph:role: osd.0 2024-04-20T02:17:51.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:17:51.983 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T02:17:52.057 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T02:17:52.492 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-20T02:17:52.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-20T02:17:52.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-20T02:17:52.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-20T02:17:52.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-20T02:17:52.772 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-20T02:17:52.772 INFO:tasks.ceph:role: osd.1 2024-04-20T02:17:52.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:17:52.772 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-20T02:17:52.847 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T02:17:52.847 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T02:17:52.847 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T02:17:52.847 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-20T02:17:52.847 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T02:17:52.848 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-20T02:17:52.848 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T02:17:52.848 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-20T02:17:52.848 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T02:17:52.848 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T02:17:53.271 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-20T02:17:53.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-20T02:17:53.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-20T02:17:53.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-20T02:17:53.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-20T02:17:53.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-20T02:17:53.485 INFO:tasks.ceph:role: osd.2 2024-04-20T02:17:53.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:17:53.486 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T02:17:53.559 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T02:17:53.999 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-04-20T02:17:54.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-04-20T02:17:54.001 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-20T02:17:54.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-20T02:17:54.167 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:17:54.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:54.255+0000 7feb1e06e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-20T02:17:54.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:54.255+0000 7feb1e06e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-20T02:17:54.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:54.255+0000 7feb1e06e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T02:17:54.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:54.256+0000 7feb1e06e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T02:17:54.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:54.256+0000 7feb1e06e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T02:17:54.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:54.263+0000 7feb1e06e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-20T02:17:57.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T02:17:57.148 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:17:57.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:57.240+0000 7efd93b977c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-20T02:17:57.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:57.241+0000 7efd93b977c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-20T02:17:57.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:57.241+0000 7efd93b977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T02:17:57.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:57.241+0000 7efd93b977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T02:17:57.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:57.241+0000 7efd93b977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T02:17:57.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:17:57.241+0000 7efd93b977c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-20T02:18:00.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T02:18:00.118 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:18:00.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:18:00.209+0000 7f4b0f90f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-20T02:18:00.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:18:00.210+0000 7f4b0f90f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-20T02:18:00.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:18:00.210+0000 7f4b0f90f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T02:18:00.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:18:00.210+0000 7f4b0f90f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T02:18:00.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:18:00.210+0000 7f4b0f90f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T02:18:00.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-20T02:18:00.210+0000 7f4b0f90f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-20T02:18:03.072 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T02:18:03.105 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-20T02:18:03.139 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-20T02:18:03.139 INFO:tasks.ceph:role: osd.3 2024-04-20T02:18:03.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:18:03.139 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-20T02:18:03.217 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T02:18:03.217 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T02:18:03.217 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T02:18:03.218 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T02:18:03.654 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-20T02:18:03.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-20T02:18:03.656 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-04-20T02:18:03.851 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-20T02:18:03.887 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-20T02:18:03.957 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-20T02:18:03.957 INFO:tasks.ceph:role: osd.4 2024-04-20T02:18:03.957 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:18:03.957 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-20T02:18:04.033 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T02:18:04.034 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T02:18:04.450 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-20T02:18:04.452 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-20T02:18:04.452 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-04-20T02:18:04.567 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-20T02:18:04.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-20T02:18:04.666 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-20T02:18:04.666 INFO:tasks.ceph:role: osd.5 2024-04-20T02:18:04.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:18:04.666 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T02:18:04.741 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T02:18:05.184 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-20T02:18:05.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-20T02:18:05.186 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-04-20T02:18:05.349 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-20T02:18:05.380 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:18:05.468 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:05.468+0000 7ffbf85877c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-20T02:18:05.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:05.469+0000 7ffbf85877c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-20T02:18:05.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:05.469+0000 7ffbf85877c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T02:18:05.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:05.469+0000 7ffbf85877c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T02:18:05.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:05.470+0000 7ffbf85877c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T02:18:05.474 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:05.474+0000 7ffbf85877c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-20T02:18:08.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T02:18:08.346 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:18:08.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:08.432+0000 7f8334bb87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-20T02:18:08.432 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:08.433+0000 7f8334bb87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-20T02:18:08.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:08.433+0000 7f8334bb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T02:18:08.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:08.433+0000 7f8334bb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T02:18:08.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:08.433+0000 7f8334bb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T02:18:08.433 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:08.433+0000 7f8334bb87c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-20T02:18:11.277 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T02:18:11.308 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:18:11.399 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:11.399+0000 7fe1794ee7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-20T02:18:11.399 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:11.400+0000 7fe1794ee7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-20T02:18:11.400 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:11.400+0000 7fe1794ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T02:18:11.400 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:11.400+0000 7fe1794ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T02:18:11.400 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:11.400+0000 7fe1794ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T02:18:11.400 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-20T02:18:11.400+0000 7fe1794ee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-20T02:18:14.249 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T02:18:14.281 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-20T02:18:14.282 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:14.282 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-20T02:18:14.314 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:14.314 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-20T02:18:14.385 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:14.386 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-20T02:18:14.454 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:14.454 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-20T02:18:14.522 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:14.522 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-20T02:18:14.555 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:14.555 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-20T02:18:14.625 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:14.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-20T02:18:14.695 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:14.695 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-20T02:18:14.754 INFO:tasks.ceph:Adding keys to all mons... 2024-04-20T02:18:14.754 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-20T02:18:14.782 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDPJSNmpWIzNRAAHkZdjU6eLfCpc5AgWrnEUg== 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDSJSNmA9hFDxAAw/8UMemULP36j2WZHbTSSA== 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDVJSNm4fxrDhAAztN85/zzKc4PH5jl2L6s0Q== 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDYJSNmFcyTDBAAi/l3kfXi254fiEIOJcPRMg== 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDdJSNm2LT9GxAA8aeEclXSjd0eIQAS32hhZQ== 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDgJSNm0EjfGRAALlO8m2dN34zDKWuUV8lrRQ== 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-04-20T02:18:14.783 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDjJSNmPsPnFxAAD/dFtTl8QcYzOCOeUSMkBQ== 2024-04-20T02:18:14.784 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-04-20T02:18:14.784 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDPJSNmSGhAOBAAah5Y7avNgIwQtMFHntftuQ== 2024-04-20T02:18:14.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T02:18:14.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T02:18:14.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T02:18:14.990 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T02:18:15.043 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T02:18:15.098 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T02:18:15.151 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T02:18:15.205 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T02:18:15.261 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-20T02:18:15.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-20T02:18:15.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T02:18:15.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-20T02:18:15.414 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-20T02:18:15.471 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-20T02:18:15.471 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-20T02:18:15.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-20T02:18:15.514 INFO:tasks.ceph.mon.a:Started 2024-04-20T02:18:15.514 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph config set mgr mgr_pool false --force 2024-04-20T02:18:15.745 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-20T02:18:15.745 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-20T02:18:15.745 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-20T02:18:15.748 INFO:tasks.ceph.mgr.x:Started 2024-04-20T02:18:15.748 INFO:tasks.ceph:Setting crush tunables to default 2024-04-20T02:18:15.748 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd crush tunables default 2024-04-20T02:18:15.957 INFO:teuthology.orchestra.run.smithi117.stderr:adjusted tunables profile to default 2024-04-20T02:18:15.969 INFO:tasks.ceph:check_enable_crimson: False 2024-04-20T02:18:15.969 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-20T02:18:15.969 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:15.969 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-20T02:18:15.995 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:15.995 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-20T02:18:16.062 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-20T02:18:16.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-20T02:18:16.129 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:16.129 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-20T02:18:16.162 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:16.162 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-20T02:18:16.234 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-20T02:18:16.234 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-20T02:18:16.264 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.265+0000 7fa7f05a3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T02:18:16.305 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 44e25b4d-4524-4393-aaf6-ed675e351875 0 2024-04-20T02:18:16.343 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.345+0000 7fa7f05a3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T02:18:16.416 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.417+0000 7fa7f05a3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T02:18:16.486 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.488+0000 7fa7f05a3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T02:18:16.559 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-04-20T02:18:16.572 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new cb83d083-1950-4842-b03e-a3fae5360ab1 1 2024-04-20T02:18:16.662 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.661+0000 7fa7f05a3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T02:18:16.784 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-04-20T02:18:16.796 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 46a99818-c29f-4d94-bbeb-615e88b1f888 2 2024-04-20T02:18:16.827 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.829+0000 7fa7f05a3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T02:18:16.936 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:16.937+0000 7fa7f05a3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T02:18:17.004 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-04-20T02:18:17.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new e6c137ef-18a4-4bb6-8850-3be95461e2ca 3 2024-04-20T02:18:17.030 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:17.032+0000 7fa7f05a3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T02:18:17.106 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:17.107+0000 7fa7f05a3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T02:18:17.228 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-04-20T02:18:17.240 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 0d0bee2c-aa82-41b0-8280-f0f320fa112f 4 2024-04-20T02:18:17.339 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:17.340+0000 7fa7f05a3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T02:18:17.410 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:17.411+0000 7fa7f05a3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T02:18:17.449 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-04-20T02:18:17.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 1a0df0a9-7714-434f-a512-7fa7b7f14fd3 5 2024-04-20T02:18:17.674 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-04-20T02:18:17.687 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-20T02:18:17.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-20T02:18:17.689 INFO:tasks.ceph.osd.0:Started 2024-04-20T02:18:17.689 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-20T02:18:17.690 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-20T02:18:17.692 INFO:tasks.ceph.osd.1:Started 2024-04-20T02:18:17.692 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-20T02:18:17.693 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-20T02:18:17.695 INFO:tasks.ceph.osd.2:Started 2024-04-20T02:18:17.696 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-20T02:18:17.696 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-20T02:18:17.698 INFO:tasks.ceph.osd.3:Started 2024-04-20T02:18:17.698 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-20T02:18:17.698 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-20T02:18:17.700 INFO:tasks.ceph.osd.4:Started 2024-04-20T02:18:17.700 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-20T02:18:17.700 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-20T02:18:17.702 INFO:tasks.ceph.osd.5:Started 2024-04-20T02:18:17.702 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T02:18:17.809 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:17.809+0000 7fa7f05a3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T02:18:17.936 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:17.936 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":8,"fsid":"be7bb238-dfe1-4609-b2f6-7166cd58fb18","created":"2024-04-20T02:18:15.644958+0000","modified":"2024-04-20T02:18:17.670950+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T02:18:17.670950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"44e25b4d-4524-4393-aaf6-ed675e351875","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb83d083-1950-4842-b03e-a3fae5360ab1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46a99818-c29f-4d94-bbeb-615e88b1f888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e6c137ef-18a4-4bb6-8850-3be95461e2ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d0bee2c-aa82-41b0-8280-f0f320fa112f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1a0df0a9-7714-434f-a512-7fa7b7f14fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T02:18:17.948 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-20T02:18:17.949 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-20T02:18:18.138 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:18.137+0000 7fa7f05a3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T02:18:18.291 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-04-20T02:18:18.291+0000 7fcf5f7237c0 -1 Falling back to public interface 2024-04-20T02:18:18.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:18:18.294+0000 7ff45c14f7c0 -1 Falling back to public interface 2024-04-20T02:18:18.296 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-20T02:18:18.296+0000 7f0e6643e7c0 -1 Falling back to public interface 2024-04-20T02:18:18.296 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-20T02:18:18.296+0000 7f69e96a47c0 -1 Falling back to public interface 2024-04-20T02:18:18.296 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-20T02:18:18.296+0000 7f69e0a62700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-20T02:18:18.298 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:18.298+0000 7fa7f05a3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T02:18:18.299 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-20T02:18:18.300+0000 7f588b7927c0 -1 Falling back to public interface 2024-04-20T02:18:18.319 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-04-20T02:18:18.319+0000 7fd381fc07c0 -1 Falling back to public interface 2024-04-20T02:18:18.378 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:18.379+0000 7fa7f05a3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T02:18:18.553 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T02:18:18.749 INFO:teuthology.misc.health.smithi117.stdout: 2024-04-20T02:18:18.749 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":8,"fsid":"be7bb238-dfe1-4609-b2f6-7166cd58fb18","created":"2024-04-20T02:18:15.644958+0000","modified":"2024-04-20T02:18:17.670950+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T02:18:17.670950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"44e25b4d-4524-4393-aaf6-ed675e351875","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb83d083-1950-4842-b03e-a3fae5360ab1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46a99818-c29f-4d94-bbeb-615e88b1f888","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e6c137ef-18a4-4bb6-8850-3be95461e2ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d0bee2c-aa82-41b0-8280-f0f320fa112f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1a0df0a9-7714-434f-a512-7fa7b7f14fd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T02:18:18.760 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-04-20T02:18:19.082 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:19.082+0000 7fa7f05a3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T02:18:19.167 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:19.167+0000 7fa7f05a3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T02:18:19.299 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:19.299+0000 7fa7f05a3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T02:18:19.842 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:19.842+0000 7fa7f05a3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T02:18:20.007 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:20.007+0000 7fa7f05a3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T02:18:20.171 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:20.171+0000 7fa7f05a3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T02:18:21.002 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:21.003+0000 7fa7f05a3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T02:18:21.308 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:21.308+0000 7fa7f05a3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T02:18:21.382 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:21.382+0000 7fa7f05a3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T02:18:21.760 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:21.760+0000 7fa7f05a3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T02:18:21.764 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-20T02:18:21.764+0000 7f0e6643e7c0 -1 osd.4 0 log_to_monitors true 2024-04-20T02:18:21.788 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-04-20T02:18:21.788+0000 7fcf5f7237c0 -1 osd.0 0 log_to_monitors true 2024-04-20T02:18:21.803 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-20T02:18:21.803+0000 7f69e96a47c0 -1 osd.3 0 log_to_monitors true 2024-04-20T02:18:21.809 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-20T02:18:21.809+0000 7f588b7927c0 -1 osd.5 0 log_to_monitors true 2024-04-20T02:18:21.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:18:21.821+0000 7ff45c14f7c0 -1 osd.1 0 log_to_monitors true 2024-04-20T02:18:21.835 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-04-20T02:18:21.836+0000 7fd381fc07c0 -1 osd.2 0 log_to_monitors true 2024-04-20T02:18:22.779 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-04-20T02:18:22.780+0000 7fa7ab819700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-20T02:18:23.413 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-04-20T02:18:23.413+0000 7fcf53adb700 -1 osd.0 0 waiting for initial osdmap 2024-04-20T02:18:23.417 INFO:tasks.ceph.osd.0.smithi117.stderr:2024-04-20T02:18:23.417+0000 7fcf4b6b5700 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T02:18:23.558 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-20T02:18:23.557+0000 7f587fb4a700 -1 osd.5 0 waiting for initial osdmap 2024-04-20T02:18:23.560 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-20T02:18:23.561+0000 7f5877724700 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T02:18:23.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:18:23.835+0000 7ff450507700 -1 osd.1 0 waiting for initial osdmap 2024-04-20T02:18:23.835 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-04-20T02:18:23.835+0000 7fd376378700 -1 osd.2 0 waiting for initial osdmap 2024-04-20T02:18:23.838 INFO:tasks.ceph.osd.2.smithi117.stderr:2024-04-20T02:18:23.839+0000 7fd371f5a700 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T02:18:23.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:18:23.839+0000 7ff44c0e9700 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T02:18:23.890 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-20T02:18:23.890+0000 7f69dda5c700 -1 osd.3 0 waiting for initial osdmap 2024-04-20T02:18:23.893 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-20T02:18:23.894+0000 7f69d5636700 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T02:18:23.910 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-20T02:18:23.911+0000 7f0e5a7f6700 -1 osd.4 0 waiting for initial osdmap 2024-04-20T02:18:23.913 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-20T02:18:23.914+0000 7f0e523d0700 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T02:18:25.365 DEBUG:teuthology.orchestra.run.smithi117:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T02:18:25.699 INFO:teuthology.misc.health.smithi117.stdout: 2024-04-20T02:18:25.699 INFO:teuthology.misc.health.smithi117.stdout:{"epoch":12,"fsid":"be7bb238-dfe1-4609-b2f6-7166cd58fb18","created":"2024-04-20T02:18:15.644958+0000","modified":"2024-04-20T02:18:24.839504+0000","last_up_change":"2024-04-20T02:18:24.839504+0000","last_in_change":"2024-04-20T02:18:17.670950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"44e25b4d-4524-4393-aaf6-ed675e351875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":41897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6801","nonce":41897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":41897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":41897}]},"public_addr":"172.21.15.117:6800/41897","cluster_addr":"172.21.15.117:6801/41897","heartbeat_back_addr":"172.21.15.117:6803/41897","heartbeat_front_addr":"172.21.15.117:6802/41897","state":["exists","up"]},{"osd":1,"uuid":"cb83d083-1950-4842-b03e-a3fae5360ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":41898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":41898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":41898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":41898}]},"public_addr":"172.21.15.117:6804/41898","cluster_addr":"172.21.15.117:6805/41898","heartbeat_back_addr":"172.21.15.117:6807/41898","heartbeat_front_addr":"172.21.15.117:6806/41898","state":["exists","up"]},{"osd":2,"uuid":"46a99818-c29f-4d94-bbeb-615e88b1f888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":41904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":41904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":41904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":41904}]},"public_addr":"172.21.15.117:6808/41904","cluster_addr":"172.21.15.117:6809/41904","heartbeat_back_addr":"172.21.15.117:6811/41904","heartbeat_front_addr":"172.21.15.117:6810/41904","state":["exists","up"]},{"osd":3,"uuid":"e6c137ef-18a4-4bb6-8850-3be95461e2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6801","nonce":41361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6803","nonce":41361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6807","nonce":41361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":41361}]},"public_addr":"172.21.15.171:6801/41361","cluster_addr":"172.21.15.171:6803/41361","heartbeat_back_addr":"172.21.15.171:6807/41361","heartbeat_front_addr":"172.21.15.171:6805/41361","state":["exists","up"]},{"osd":4,"uuid":"0d0bee2c-aa82-41b0-8280-f0f320fa112f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":41362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":41362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":41362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":41362}]},"public_addr":"172.21.15.171:6800/41362","cluster_addr":"172.21.15.171:6802/41362","heartbeat_back_addr":"172.21.15.171:6806/41362","heartbeat_front_addr":"172.21.15.171:6804/41362","state":["exists","up"]},{"osd":5,"uuid":"1a0df0a9-7714-434f-a512-7fa7b7f14fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":41363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":41363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6811","nonce":41363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":41363}]},"public_addr":"172.21.15.171:6808/41363","cluster_addr":"172.21.15.171:6809/41363","heartbeat_back_addr":"172.21.15.171:6811/41363","heartbeat_front_addr":"172.21.15.171:6810/41363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T02:18:25.712 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-04-20T02:18:25.712 INFO:tasks.ceph:Creating RBD pool 2024-04-20T02:18:25.712 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-20T02:18:26.853 INFO:teuthology.orchestra.run.smithi117.stderr:pool 'rbd' created 2024-04-20T02:18:26.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-20T02:18:27.861 INFO:teuthology.orchestra.run.smithi117.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-20T02:18:27.875 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-20T02:18:27.875 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-20T02:18:27.875 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-20T02:18:27.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-20T02:18:27.876 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-20T02:18:28.263 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:28.275 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":4,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":41672}]},"active_addr":"172.21.15.117:6812/41672","active_change":"2024-04-20T02:18:21.774095+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":2882761278}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1126608718}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":18726824}]}]} 2024-04-20T02:18:28.277 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-20T02:18:28.277 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-20T02:18:28.278 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T02:18:28.604 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:28.604 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":15,"fsid":"be7bb238-dfe1-4609-b2f6-7166cd58fb18","created":"2024-04-20T02:18:15.644958+0000","modified":"2024-04-20T02:18:27.850882+0000","last_up_change":"2024-04-20T02:18:24.839504+0000","last_in_change":"2024-04-20T02:18:17.670950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-20T02:18:26.064735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44e25b4d-4524-4393-aaf6-ed675e351875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":41897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6801","nonce":41897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":41897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":41897}]},"public_addr":"172.21.15.117:6800/41897","cluster_addr":"172.21.15.117:6801/41897","heartbeat_back_addr":"172.21.15.117:6803/41897","heartbeat_front_addr":"172.21.15.117:6802/41897","state":["exists","up"]},{"osd":1,"uuid":"cb83d083-1950-4842-b03e-a3fae5360ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":41898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":41898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":41898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":41898}]},"public_addr":"172.21.15.117:6804/41898","cluster_addr":"172.21.15.117:6805/41898","heartbeat_back_addr":"172.21.15.117:6807/41898","heartbeat_front_addr":"172.21.15.117:6806/41898","state":["exists","up"]},{"osd":2,"uuid":"46a99818-c29f-4d94-bbeb-615e88b1f888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":41904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":41904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":41904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":41904}]},"public_addr":"172.21.15.117:6808/41904","cluster_addr":"172.21.15.117:6809/41904","heartbeat_back_addr":"172.21.15.117:6811/41904","heartbeat_front_addr":"172.21.15.117:6810/41904","state":["exists","up"]},{"osd":3,"uuid":"e6c137ef-18a4-4bb6-8850-3be95461e2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6801","nonce":41361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6803","nonce":41361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6807","nonce":41361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":41361}]},"public_addr":"172.21.15.171:6801/41361","cluster_addr":"172.21.15.171:6803/41361","heartbeat_back_addr":"172.21.15.171:6807/41361","heartbeat_front_addr":"172.21.15.171:6805/41361","state":["exists","up"]},{"osd":4,"uuid":"0d0bee2c-aa82-41b0-8280-f0f320fa112f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":41362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":41362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":41362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":41362}]},"public_addr":"172.21.15.171:6800/41362","cluster_addr":"172.21.15.171:6802/41362","heartbeat_back_addr":"172.21.15.171:6806/41362","heartbeat_front_addr":"172.21.15.171:6804/41362","state":["exists","up"]},{"osd":5,"uuid":"1a0df0a9-7714-434f-a512-7fa7b7f14fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":41363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":41363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6811","nonce":41363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":41363}]},"public_addr":"172.21.15.171:6808/41363","cluster_addr":"172.21.15.171:6809/41363","heartbeat_back_addr":"172.21.15.171:6811/41363","heartbeat_front_addr":"172.21.15.171:6810/41363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.797612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:23.891650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.775004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T02:18:28.618 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-20T02:18:28.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T02:18:28.951 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:28.951 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"fsid":"be7bb238-dfe1-4609-b2f6-7166cd58fb18","created":"2024-04-20T02:18:15.644958+0000","modified":"2024-04-20T02:18:28.854340+0000","last_up_change":"2024-04-20T02:18:24.839504+0000","last_in_change":"2024-04-20T02:18:17.670950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-20T02:18:26.064735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44e25b4d-4524-4393-aaf6-ed675e351875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":41897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6801","nonce":41897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":41897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":41897}]},"public_addr":"172.21.15.117:6800/41897","cluster_addr":"172.21.15.117:6801/41897","heartbeat_back_addr":"172.21.15.117:6803/41897","heartbeat_front_addr":"172.21.15.117:6802/41897","state":["exists","up"]},{"osd":1,"uuid":"cb83d083-1950-4842-b03e-a3fae5360ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":41898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":41898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":41898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":41898}]},"public_addr":"172.21.15.117:6804/41898","cluster_addr":"172.21.15.117:6805/41898","heartbeat_back_addr":"172.21.15.117:6807/41898","heartbeat_front_addr":"172.21.15.117:6806/41898","state":["exists","up"]},{"osd":2,"uuid":"46a99818-c29f-4d94-bbeb-615e88b1f888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":41904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":41904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":41904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":41904}]},"public_addr":"172.21.15.117:6808/41904","cluster_addr":"172.21.15.117:6809/41904","heartbeat_back_addr":"172.21.15.117:6811/41904","heartbeat_front_addr":"172.21.15.117:6810/41904","state":["exists","up"]},{"osd":3,"uuid":"e6c137ef-18a4-4bb6-8850-3be95461e2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6801","nonce":41361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6803","nonce":41361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6807","nonce":41361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":41361}]},"public_addr":"172.21.15.171:6801/41361","cluster_addr":"172.21.15.171:6803/41361","heartbeat_back_addr":"172.21.15.171:6807/41361","heartbeat_front_addr":"172.21.15.171:6805/41361","state":["exists","up"]},{"osd":4,"uuid":"0d0bee2c-aa82-41b0-8280-f0f320fa112f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":41362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":41362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":41362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":41362}]},"public_addr":"172.21.15.171:6800/41362","cluster_addr":"172.21.15.171:6802/41362","heartbeat_back_addr":"172.21.15.171:6806/41362","heartbeat_front_addr":"172.21.15.171:6804/41362","state":["exists","up"]},{"osd":5,"uuid":"1a0df0a9-7714-434f-a512-7fa7b7f14fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":41363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":41363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6811","nonce":41363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":41363}]},"public_addr":"172.21.15.171:6808/41363","cluster_addr":"172.21.15.171:6809/41363","heartbeat_back_addr":"172.21.15.171:6811/41363","heartbeat_front_addr":"172.21.15.171:6810/41363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.797612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:23.891650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.775004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T02:18:28.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-20T02:18:28.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-20T02:18:28.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-20T02:18:28.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-20T02:18:28.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-20T02:18:28.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-20T02:18:29.170 INFO:teuthology.orchestra.run.smithi117.stdout:51539607556 2024-04-20T02:18:29.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-20T02:18:29.185 INFO:teuthology.orchestra.run.smithi117.stdout:51539607556 2024-04-20T02:18:29.185 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-20T02:18:29.218 INFO:teuthology.orchestra.run.smithi117.stdout:51539607555 2024-04-20T02:18:29.219 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-20T02:18:29.224 INFO:teuthology.orchestra.run.smithi117.stdout:47244640259 2024-04-20T02:18:29.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-20T02:18:29.231 INFO:teuthology.orchestra.run.smithi117.stdout:47244640260 2024-04-20T02:18:29.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-20T02:18:29.232 INFO:teuthology.orchestra.run.smithi117.stdout:51539607557 2024-04-20T02:18:29.233 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-20T02:18:29.589 INFO:teuthology.orchestra.run.smithi117.stdout:51539607555 2024-04-20T02:18:29.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.4 2024-04-20T02:18:29.654 INFO:teuthology.orchestra.run.smithi117.stdout:51539607554 2024-04-20T02:18:29.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.2 2024-04-20T02:18:29.739 INFO:teuthology.orchestra.run.smithi117.stdout:51539607555 2024-04-20T02:18:29.740 INFO:teuthology.orchestra.run.smithi117.stdout:47244640257 2024-04-20T02:18:29.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640257 for osd.0 2024-04-20T02:18:29.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.1 2024-04-20T02:18:29.781 INFO:teuthology.orchestra.run.smithi117.stdout:47244640258 2024-04-20T02:18:29.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.5 2024-04-20T02:18:29.819 INFO:teuthology.orchestra.run.smithi117.stdout:51539607556 2024-04-20T02:18:29.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607556 for osd.3 2024-04-20T02:18:30.610 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-20T02:18:30.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-20T02:18:30.756 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-20T02:18:30.761 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-20T02:18:30.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-20T02:18:30.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-20T02:18:31.004 INFO:teuthology.orchestra.run.smithi117.stdout:51539607556 2024-04-20T02:18:31.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607556 for osd.4 2024-04-20T02:18:31.025 DEBUG:teuthology.parallel:result is None 2024-04-20T02:18:31.176 INFO:teuthology.orchestra.run.smithi117.stdout:51539607555 2024-04-20T02:18:31.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607555 for osd.2 2024-04-20T02:18:31.202 DEBUG:teuthology.parallel:result is None 2024-04-20T02:18:31.211 INFO:teuthology.orchestra.run.smithi117.stdout:51539607556 2024-04-20T02:18:31.219 INFO:teuthology.orchestra.run.smithi117.stdout:47244640260 2024-04-20T02:18:31.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607556 for osd.1 2024-04-20T02:18:31.226 DEBUG:teuthology.parallel:result is None 2024-04-20T02:18:31.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.5 2024-04-20T02:18:31.234 DEBUG:teuthology.parallel:result is None 2024-04-20T02:18:31.254 INFO:teuthology.orchestra.run.smithi117.stdout:51539607557 2024-04-20T02:18:31.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.3 2024-04-20T02:18:31.268 DEBUG:teuthology.parallel:result is None 2024-04-20T02:18:31.273 INFO:teuthology.orchestra.run.smithi117.stdout:47244640259 2024-04-20T02:18:31.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2024-04-20T02:18:31.288 DEBUG:teuthology.parallel:result is None 2024-04-20T02:18:31.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-20T02:18:31.288 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:18:31.651 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:31.653 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:18:31.664 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-20T02:18:29.778175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162908,"kb_used_data":768,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068132,"statfs":{"total":579820584960,"available":579653767168,"internally_reserved":0,"allocated":786432,"data_stored":213322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":165927590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-20T02:18:28.856870+0000","last_change":"2024-04-20T02:18:27.863872+0000","last_active":"2024-04-20T02:18:28.856870+0000","last_peered":"2024-04-20T02:18:28.856870+0000","last_clean":"2024-04-20T02:18:28.856870+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:18:28.856870+0000","last_undegraded":"2024-04-20T02:18:28.856870+0000","last_fullsized":"2024-04-20T02:18:28.856870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-20T02:18:28.856838+0000","last_change":"2024-04-20T02:18:27.862246+0000","last_active":"2024-04-20T02:18:28.856838+0000","last_peered":"2024-04-20T02:18:28.856838+0000","last_clean":"2024-04-20T02:18:28.856838+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:18:28.856838+0000","last_undegraded":"2024-04-20T02:18:28.856838+0000","last_fullsized":"2024-04-20T02:18:28.856838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:27.862873+0000","last_change":"2024-04-20T02:18:27.862322+0000","last_active":"2024-04-20T02:18:27.862873+0000","last_peered":"2024-04-20T02:18:27.862873+0000","last_clean":"2024-04-20T02:18:27.862873+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:18:27.862873+0000","last_undegraded":"2024-04-20T02:18:27.862873+0000","last_fullsized":"2024-04-20T02:18:27.862873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-20T02:18:28.856849+0000","last_change":"2024-04-20T02:18:27.863608+0000","last_active":"2024-04-20T02:18:28.856849+0000","last_peered":"2024-04-20T02:18:28.856849+0000","last_clean":"2024-04-20T02:18:28.856849+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:18:28.856849+0000","last_undegraded":"2024-04-20T02:18:28.856849+0000","last_fullsized":"2024-04-20T02:18:28.856849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:27.864491+0000","last_change":"2024-04-20T02:18:27.861334+0000","last_active":"2024-04-20T02:18:27.864491+0000","last_peered":"2024-04-20T02:18:27.864491+0000","last_clean":"2024-04-20T02:18:27.864491+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:18:27.864491+0000","last_undegraded":"2024-04-20T02:18:27.864491+0000","last_fullsized":"2024-04-20T02:18:27.864491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:06:23.060909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:27.865454+0000","last_change":"2024-04-20T02:18:27.862623+0000","last_active":"2024-04-20T02:18:27.865454+0000","last_peered":"2024-04-20T02:18:27.865454+0000","last_clean":"2024-04-20T02:18:27.865454+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:18:27.865454+0000","last_undegraded":"2024-04-20T02:18:27.865454+0000","last_fullsized":"2024-04-20T02:18:27.865454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:27.862719+0000","last_change":"2024-04-20T02:18:27.861031+0000","last_active":"2024-04-20T02:18:27.862719+0000","last_peered":"2024-04-20T02:18:27.862719+0000","last_clean":"2024-04-20T02:18:27.862719+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:18:27.862719+0000","last_undegraded":"2024-04-20T02:18:27.862719+0000","last_fullsized":"2024-04-20T02:18:27.862719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:27.868520+0000","last_change":"2024-04-20T02:18:27.862673+0000","last_active":"2024-04-20T02:18:27.868520+0000","last_peered":"2024-04-20T02:18:27.868520+0000","last_clean":"2024-04-20T02:18:27.868520+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:18:27.868520+0000","last_undegraded":"2024-04-20T02:18:27.868520+0000","last_fullsized":"2024-04-20T02:18:27.868520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":35156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":126976,"data_stored":34520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":2,"up_from":12,"seq":51539607555,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":35156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":1,"up_from":12,"seq":51539607556,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":38814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":126976,"data_stored":34520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":35156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:18:31.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:18:31.991 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:31.994 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:18:32.005 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-04-20T02:18:31.778449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162932,"kb_used_data":784,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068108,"statfs":{"total":579820584960,"available":579653742592,"internally_reserved":0,"allocated":802816,"data_stored":220638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":165927590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-20T02:18:28.856870+0000","last_change":"2024-04-20T02:18:27.863872+0000","last_active":"2024-04-20T02:18:28.856870+0000","last_peered":"2024-04-20T02:18:28.856870+0000","last_clean":"2024-04-20T02:18:28.856870+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:18:28.856870+0000","last_undegraded":"2024-04-20T02:18:28.856870+0000","last_fullsized":"2024-04-20T02:18:28.856870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-20T02:18:28.856838+0000","last_change":"2024-04-20T02:18:27.862246+0000","last_active":"2024-04-20T02:18:28.856838+0000","last_peered":"2024-04-20T02:18:28.856838+0000","last_clean":"2024-04-20T02:18:28.856838+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:18:28.856838+0000","last_undegraded":"2024-04-20T02:18:28.856838+0000","last_fullsized":"2024-04-20T02:18:28.856838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:29.201262+0000","last_change":"2024-04-20T02:18:27.862322+0000","last_active":"2024-04-20T02:18:29.201262+0000","last_peered":"2024-04-20T02:18:29.201262+0000","last_clean":"2024-04-20T02:18:29.201262+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:18:29.201262+0000","last_undegraded":"2024-04-20T02:18:29.201262+0000","last_fullsized":"2024-04-20T02:18:29.201262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-20T02:18:28.856849+0000","last_change":"2024-04-20T02:18:27.863608+0000","last_active":"2024-04-20T02:18:28.856849+0000","last_peered":"2024-04-20T02:18:28.856849+0000","last_clean":"2024-04-20T02:18:28.856849+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:18:28.856849+0000","last_undegraded":"2024-04-20T02:18:28.856849+0000","last_fullsized":"2024-04-20T02:18:28.856849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:27.864491+0000","last_change":"2024-04-20T02:18:27.861334+0000","last_active":"2024-04-20T02:18:27.864491+0000","last_peered":"2024-04-20T02:18:27.864491+0000","last_clean":"2024-04-20T02:18:27.864491+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:18:27.864491+0000","last_undegraded":"2024-04-20T02:18:27.864491+0000","last_fullsized":"2024-04-20T02:18:27.864491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:06:23.060909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:29.151798+0000","last_change":"2024-04-20T02:18:27.862623+0000","last_active":"2024-04-20T02:18:29.151798+0000","last_peered":"2024-04-20T02:18:29.151798+0000","last_clean":"2024-04-20T02:18:29.151798+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:18:29.151798+0000","last_undegraded":"2024-04-20T02:18:29.151798+0000","last_fullsized":"2024-04-20T02:18:29.151798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:29.207155+0000","last_change":"2024-04-20T02:18:27.861031+0000","last_active":"2024-04-20T02:18:29.207155+0000","last_peered":"2024-04-20T02:18:29.207155+0000","last_clean":"2024-04-20T02:18:29.207155+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:18:29.207155+0000","last_undegraded":"2024-04-20T02:18:29.207155+0000","last_fullsized":"2024-04-20T02:18:29.207155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-20T02:18:29.201285+0000","last_change":"2024-04-20T02:18:27.862673+0000","last_active":"2024-04-20T02:18:29.201285+0000","last_peered":"2024-04-20T02:18:29.201285+0000","last_clean":"2024-04-20T02:18:29.201285+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:18:29.201285+0000","last_undegraded":"2024-04-20T02:18:29.201285+0000","last_fullsized":"2024-04-20T02:18:29.201285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":35156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":3,"up_from":12,"seq":51539607558,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":135168,"data_stored":38178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4209999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":2,"up_from":12,"seq":51539607556,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":38814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":1,"up_from":12,"seq":51539607557,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":38814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":126976,"data_stored":34520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":35156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:18:32.006 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-20T02:18:32.006 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-20T02:18:32.006 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-20T02:18:32.006 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-20T02:18:32.374 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:18:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-20T02:18:32.389 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-20T02:18:32.389 INFO:teuthology.run_tasks:Running task full_sequential... 2024-04-20T02:18:32.398 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-04-20T02:18:32.399 INFO:teuthology.task.exec:Executing custom commands... 2024-04-20T02:18:32.399 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:18:32.399 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33' 2024-04-20T02:18:32.564 INFO:teuthology.orchestra.run.smithi171.stdout:{} 2024-04-20T02:18:32.565 INFO:teuthology.orchestra.run.smithi171.stderr:filestore_debug_random_read_err = '' (not observed, change may require restart) 2024-04-20T02:18:32.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33' 2024-04-20T02:18:32.725 INFO:teuthology.orchestra.run.smithi171.stdout:{} 2024-04-20T02:18:32.726 INFO:teuthology.orchestra.run.smithi171.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-04-20T02:18:32.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create test 16 16' 2024-04-20T02:18:33.878 INFO:teuthology.orchestra.run.smithi171.stderr:pool 'test' created 2024-04-20T02:18:33.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set test size 3' 2024-04-20T02:18:34.880 INFO:teuthology.orchestra.run.smithi171.stderr:set pool 2 size to 3 2024-04-20T02:18:34.895 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph pg dump pgs --format=json-pretty' 2024-04-20T02:18:35.232 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-20T02:18:35.232 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-04-20T02:18:35.232 INFO:teuthology.orchestra.run.smithi171.stdout: "pg_ready": true, 2024-04-20T02:18:35.232 INFO:teuthology.orchestra.run.smithi171.stdout: "pg_stats": [ 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.f", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.233 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.234 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.235 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.236 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.237 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.238 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.e", 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.239 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.240 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.241 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.242 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.243 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.244 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.245 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.d", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.246 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.248 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.249 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.250 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.251 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.c", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.252 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.254 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.255 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.256 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.257 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.b", 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.258 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.259 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.260 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.261 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.262 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.263 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.a", 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.264 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.265 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.266 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.267 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.268 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.269 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.9", 2024-04-20T02:18:35.270 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.271 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.272 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.273 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.274 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.275 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.8", 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.276 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.277 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.278 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.279 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.280 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.281 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.282 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.5", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 15, 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.862673+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.862386+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.862386+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.283 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:29.201285+0000", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.284 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000", 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.285 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.286 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.287 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: 2, 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: 3 2024-04-20T02:18:35.288 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: 2, 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: 3 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 2, 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 2, 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.6", 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.289 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.290 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.291 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.292 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.293 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.294 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.295 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.4", 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 15, 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.296 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.861031+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.860699+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.860699+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:29.207155+0000", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.297 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.298 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000", 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.299 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.300 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.301 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: 3, 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: 0 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: 3, 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: 0 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.302 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 3, 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 3, 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.7", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.303 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.304 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.305 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.306 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.307 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.308 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.3", 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 15, 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.309 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.862623+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.862294+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.862294+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:29.151798+0000", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.310 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.311 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000", 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.312 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.313 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.314 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: 4, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: 1 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: 4, 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: 1 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.315 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 4, 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 4, 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.0", 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.316 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.317 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.318 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.319 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.320 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.321 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.2", 2024-04-20T02:18:35.322 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 15, 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.861334+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.860999+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.860999+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:28.833831+0000", 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.323 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.324 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T11:06:23.060909+0000", 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.325 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: 3 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: 0, 2024-04-20T02:18:35.328 INFO:teuthology.orchestra.run.smithi171.stdout: 3 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 0, 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 0, 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.1", 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.329 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.330 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.331 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.332 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.333 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.334 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.0", 2024-04-20T02:18:35.335 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 16, 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.863608+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.863359+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.863359+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:28.856849+0000", 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.336 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.337 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000", 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.338 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.339 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.340 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: 1, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: 5 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: 1, 2024-04-20T02:18:35.341 INFO:teuthology.orchestra.run.smithi171.stdout: 5 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 1, 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 1, 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.3", 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.342 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.343 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.344 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.345 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.346 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.347 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.348 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.1", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 15, 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.862322+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.861960+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.861960+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.349 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:29.201262+0000", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.350 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000", 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.351 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.352 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.353 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: 2, 2024-04-20T02:18:35.354 INFO:teuthology.orchestra.run.smithi171.stdout: 4 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: 2, 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: 4 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 2, 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 2, 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.355 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.2", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.356 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.357 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.358 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.359 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.360 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.361 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.6", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 16, 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.862246+0000", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.861922+0000", 2024-04-20T02:18:35.362 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.861922+0000", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:28.856838+0000", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.363 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000", 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.364 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.365 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.366 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: 1, 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: 4 2024-04-20T02:18:35.367 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: 1, 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: 4 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 1, 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 1, 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.5", 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.368 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.369 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.370 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.371 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.372 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.373 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.374 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "1.7", 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 10, 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 16, 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "active+clean", 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:27.863872+0000", 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.375 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "2024-04-20T02:18:27.863649+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "2024-04-20T02:18:27.863649+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:28.856870+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 14, 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 14, 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 15, 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.376 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:26.845603+0000", 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.377 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000", 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.378 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.379 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.380 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [ 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: 1, 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: 3 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [ 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: 1, 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: 3 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: ], 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": 1, 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": 1, 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.381 INFO:teuthology.orchestra.run.smithi171.stdout: { 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "pgid": "2.4", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "version": "0'0", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_seq": 0, 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "reported_epoch": 0, 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "state": "unknown", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fresh": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_change": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_active": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_peered": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_active": "0.000000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_became_peered": "0.000000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_unstale": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_undegraded": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.382 INFO:teuthology.orchestra.run.smithi171.stdout: "last_fullsized": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "mapping_epoch": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "log_start": "0'0", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_start": "0'0", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "created": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "last_epoch_clean": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "parent": "0.0", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "parent_split_bits": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub": "0'0", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub": "0'0", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "last_deep_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "last_clean_scrub_stamp": "2024-04-20T02:18:33.869494+0000", 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_scrubbed": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "log_size": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "log_dups_size": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "ondisk_log_size": 0, 2024-04-20T02:18:35.383 INFO:teuthology.orchestra.run.smithi171.stdout: "stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "dirty_stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "hitset_bytes_stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "pin_stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "manifest_stats_invalid": false, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrimq_len": 0, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "last_scrub_duration": 0, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_schedule": "--", 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_duration": 0, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "objects_trimmed": 0, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "snaptrim_duration": 0, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "stat_sum": { 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes": 0, 2024-04-20T02:18:35.384 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_clones": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_object_copies": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing_on_primary": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_missing": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_degraded": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_misplaced": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_unfound": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_dirty": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_whiteouts": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_read_kb": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_write_kb": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_scrub_errors": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_shallow_scrub_errors": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_deep_scrub_errors": 0, 2024-04-20T02:18:35.385 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_recovered": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_recovered": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_keys_recovered": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_omap": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_hit_set_archive": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_bytes_hit_set_archive": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_kb": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_kb": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_promote": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_high": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_flush_mode_low": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_some": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_evict_mode_full": 0, 2024-04-20T02:18:35.386 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_pinned": 0, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "num_legacy_snapsets": 0, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "num_large_omap_objects": 0, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_manifest": 0, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_bytes": 0, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "num_omap_keys": 0, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "num_objects_repaired": 0 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "up": [], 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "acting": [], 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "avail_no_missing": [], 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "object_location_counts": [], 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "blocked_by": [], 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "up_primary": -1, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "acting_primary": -1, 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: "purged_snaps": [] 2024-04-20T02:18:35.387 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-04-20T02:18:35.388 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-04-20T02:18:35.388 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-04-20T02:18:35.389 INFO:teuthology.orchestra.run.smithi171.stderr:dumped pgs 2024-04-20T02:18:35.389 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-20T02:18:35.391 INFO:tasks.radosbench:Beginning radosbench... 2024-04-20T02:18:35.391 DEBUG:teuthology.orchestra.run.smithi171:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 1048576 -p test bench 60 write --no-cleanup' 2024-04-20T02:18:35.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:hints = 1 2024-04-20T02:18:35.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 1048576 for up to 60 seconds or 0 objects 2024-04-20T02:18:35.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Object prefix: benchmark_data_smithi171_44355 2024-04-20T02:18:35.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:18:35.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 0 0 0 0 0 0 - 0 2024-04-20T02:18:36.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 1 16 884 868 54.249 54.25 0.0101767 0.0183425 2024-04-20T02:18:37.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 2 16 2806 2790 87.1834 120.125 0.00402478 0.0114171 2024-04-20T02:18:38.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 3 15 4793 4778 99.536 124.25 0.00549615 0.0100305 2024-04-20T02:18:39.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 4 16 6822 6806 106.337 126.75 0.00521609 0.00938622 2024-04-20T02:18:40.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 5 16 8696 8680 108.493 117.125 0.00699237 0.00920534 2024-04-20T02:18:41.449 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 6 15 10347 10332 107.618 103.25 0.00441835 0.00928352 2024-04-20T02:18:42.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 7 16 11908 11892 106.171 97.5 0.00626713 0.00940748 2024-04-20T02:18:43.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 8 16 13433 13417 104.813 95.3125 0.0091911 0.00953156 2024-04-20T02:18:44.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 9 16 14970 14954 103.84 96.0625 0.014356 0.00962176 2024-04-20T02:18:45.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 10 16 16395 16379 102.362 89.0625 0.00603042 0.00976463 2024-04-20T02:18:46.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 11 16 17832 17816 101.22 89.8125 0.0095027 0.00987087 2024-04-20T02:18:47.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 12 16 19252 19236 100.18 88.75 0.00927245 0.0099738 2024-04-20T02:18:48.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 13 16 20626 20610 99.0795 85.875 0.0113967 0.0100837 2024-04-20T02:18:49.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 14 16 22028 22012 98.2606 87.625 0.0158379 0.0101672 2024-04-20T02:18:50.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 15 16 23348 23332 97.2095 82.5 0.0108541 0.0102822 2024-04-20T02:18:51.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 16 16 24715 24699 96.4733 85.4375 0.0096773 0.0103595 2024-04-20T02:18:52.450 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 17 16 26035 26019 95.6508 82.5 0.0133915 0.0104437 2024-04-20T02:18:53.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 18 16 27355 27339 94.9179 82.5 0.0174233 0.0105269 2024-04-20T02:18:54.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 19 16 28587 28571 93.9745 77 0.0147189 0.010634 2024-04-20T02:18:55.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:18:55.453017+0000 min lat: 0.0014981 max lat: 0.451209 avg lat: 0.0107177 2024-04-20T02:18:55.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:18:55.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 20 16 29862 29846 93.2599 79.6875 0.00727753 0.0107177 2024-04-20T02:18:56.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 21 16 31066 31050 92.402 75.25 0.0197881 0.0108138 2024-04-20T02:18:57.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 22 15 32349 32334 91.8495 80.25 0.0187817 0.0108809 2024-04-20T02:18:58.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 23 16 33537 33521 91.0814 74.1875 0.0111281 0.0109736 2024-04-20T02:18:59.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 24 16 34790 34774 90.5492 78.3125 0.0176389 0.0110349 2024-04-20T02:19:00.451 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 25 16 35910 35894 89.727 70 0.00986637 0.0111397 2024-04-20T02:19:01.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 26 15 37075 37060 89.0786 72.875 0.0196868 0.0112191 2024-04-20T02:19:02.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 27 16 38256 38240 88.5107 73.75 0.0151141 0.0112925 2024-04-20T02:19:03.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 28 16 39428 39412 87.9655 73.25 0.0260012 0.0113605 2024-04-20T02:19:04.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 29 16 40571 40555 87.3954 71.4375 0.00875909 0.0114364 2024-04-20T02:19:05.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 30 16 41622 41606 86.6716 65.6875 0.00880777 0.0115317 2024-04-20T02:19:06.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 31 16 42762 42746 86.174 71.25 0.0107182 0.0115984 2024-04-20T02:19:07.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 32 16 43834 43818 85.5746 67 0.00739333 0.0116809 2024-04-20T02:19:08.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 33 16 44911 44895 85.0211 67.3125 0.0178719 0.0117554 2024-04-20T02:19:09.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 34 16 45999 45983 84.5203 68 0.0179903 0.0118257 2024-04-20T02:19:10.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 35 16 47092 47076 84.0571 68.3125 0.0176011 0.0118915 2024-04-20T02:19:11.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 36 16 48093 48077 83.4599 62.5625 0.0182741 0.0119756 2024-04-20T02:19:12.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 37 16 49139 49123 82.971 65.375 0.0171224 0.0120466 2024-04-20T02:19:13.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 38 16 50163 50147 82.4716 64 0.0183156 0.0121207 2024-04-20T02:19:14.452 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 39 16 51135 51119 81.9145 60.75 0.0188271 0.0122012 2024-04-20T02:19:15.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:19:15.454504+0000 min lat: 0.0014981 max lat: 0.451209 avg lat: 0.0122665 2024-04-20T02:19:15.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:19:15.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 40 16 52171 52155 81.4853 64.75 0.0134397 0.0122665 2024-04-20T02:19:16.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 41 16 53089 53073 80.8971 57.375 0.0160998 0.0123561 2024-04-20T02:19:17.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 42 16 54086 54070 80.4545 62.3125 0.0266388 0.0124213 2024-04-20T02:19:18.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 43 16 55067 55051 80.0092 61.3125 0.00609739 0.0124935 2024-04-20T02:19:19.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 44 16 56020 56004 79.5445 59.5625 0.0239586 0.0125663 2024-04-20T02:19:20.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 45 16 56975 56959 79.1031 59.6875 0.0124409 0.0126365 2024-04-20T02:19:21.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 46 16 57912 57896 78.6565 58.5625 0.00743618 0.0127083 2024-04-20T02:19:22.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 47 16 58870 58854 78.2568 59.875 0.0207405 0.0127726 2024-04-20T02:19:23.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 48 16 59807 59791 77.8464 58.5625 0.012504 0.0128407 2024-04-20T02:19:24.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 49 16 60703 60687 77.4005 56 0.0190007 0.0129137 2024-04-20T02:19:25.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 50 16 61604 61588 76.9787 56.3125 0.0178561 0.0129855 2024-04-20T02:19:26.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 51 16 62470 62454 76.5305 54.125 0.0075765 0.0130598 2024-04-20T02:19:27.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 52 16 63289 63273 76.0431 51.1875 0.0141209 0.0131456 2024-04-20T02:19:28.453 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 53 16 64183 64167 75.6624 55.875 0.0154213 0.0132117 2024-04-20T02:19:29.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 54 16 65094 65078 75.3156 56.9375 0.00987692 0.013273 2024-04-20T02:19:30.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 55 16 65940 65924 74.9075 52.875 0.0139621 0.0133451 2024-04-20T02:19:31.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 56 15 66812 66797 74.5442 54.5625 0.018219 0.0134099 2024-04-20T02:19:32.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 57 16 67637 67621 74.1398 51.5 0.00966501 0.0134833 2024-04-20T02:19:33.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 58 16 68487 68471 73.7774 53.125 0.0111678 0.0135506 2024-04-20T02:19:34.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 59 16 69282 69266 73.3691 49.6875 0.0219039 0.0136252 2024-04-20T02:19:35.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:19:35.455965+0000 min lat: 0.0014981 max lat: 0.451209 avg lat: 0.0136994 2024-04-20T02:19:35.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:19:35.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 60 14 70055 70041 72.9535 48.4375 0.0384698 0.0136994 2024-04-20T02:19:36.454 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Total time run: 60.0213 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Total writes made: 70055 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Write size: 65536 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Object size: 1048576 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Bandwidth (MB/sec): 72.9481 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Stddev Bandwidth: 18.9171 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Max bandwidth (MB/sec): 126.75 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Min bandwidth (MB/sec): 48.4375 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Average IOPS: 1167 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Stddev IOPS: 302.674 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Max IOPS: 2028 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Min IOPS: 775 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Average Latency(s): 0.0137033 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Stddev Latency(s): 0.00935841 2024-04-20T02:19:36.455 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Max latency(s): 0.451209 2024-04-20T02:19:36.456 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Min latency(s): 0.0014981 2024-04-20T02:19:36.462 DEBUG:teuthology.orchestra.run.smithi171:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -p test bench 360 rand' 2024-04-20T02:19:36.465 INFO:tasks.radosbench:joining radosbench (timing out after 11100s) 2024-04-20T02:19:36.465 INFO:teuthology.orchestra.run:waiting for 11100 2024-04-20T02:19:36.517 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:hints = 1 2024-04-20T02:19:36.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:19:36.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 0 0 0 0 0 0 - 0 2024-04-20T02:19:36.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.526+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:19:36.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:19:36.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.550+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:19:36.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.550+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:19:36.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.588+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:19:36.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:19:36.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.611+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:19:36.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.632+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:19:36.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.650+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:19:36.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.665+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:19:36.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.684+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:19:36.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.698+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:19:36.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:19:36.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.720+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:19:36.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.747+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:19:36.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.760+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:19:36.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.770+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:19:36.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.778+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:19:36.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.791+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:19:36.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.806+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:19:36.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.808+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:19:36.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:19:36.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.865+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:19:36.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:19:36.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:19:36.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.968+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:19:36.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.974+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:19:36.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.977+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:19:36.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:36.993+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:19:37.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.026+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:19:37.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.069+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:19:37.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.073+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:19:37.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.091+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:19:37.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.100+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:19:37.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.113+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:19:37.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.120+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:19:37.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:19:37.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.146+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:19:37.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:19:37.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:19:37.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.180+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:19:37.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.213+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:19:37.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.255+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:19:37.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.256+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:19:37.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.273+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:19:37.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.303+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:19:37.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.307+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:19:37.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.329+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:19:37.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.335+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:19:37.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.393+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:19:37.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.407+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:19:37.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.417+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:19:37.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:19:37.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.435+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:19:37.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.461+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:19:37.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.466+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:19:37.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.470+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:19:37.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.492+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:19:37.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.494+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:19:37.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.515+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:19:37.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 1 15 14298 14283 892.581 892.688 0.000734579 0.00110551 2024-04-20T02:19:37.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.549+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:19:37.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.550+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:19:37.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.560+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:19:37.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.587+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:19:37.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.589+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:19:37.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:19:37.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.618+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:19:37.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:19:37.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.655+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:19:37.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:19:37.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.689+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:19:37.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.697+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:19:37.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.707+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:19:37.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.723+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:19:37.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.740+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:19:37.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.758+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:19:37.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.764+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:19:37.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.768+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:19:37.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.781+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:19:37.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:19:37.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.793+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:19:37.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.830+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:19:37.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.862+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:19:37.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.882+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:19:37.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.884+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:19:37.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:19:37.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.932+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:19:37.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.935+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:19:37.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.956+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:19:37.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.961+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:19:37.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:37.996+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:19:38.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.021+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:19:38.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.029+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:19:38.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.072+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:19:38.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.119+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:38.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.125+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:19:38.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.139+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:19:38.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.169+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:19:38.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.232+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:38.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.272+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:19:38.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.276+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:19:38.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.291+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:19:38.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.292+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:19:38.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.319+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:19:38.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.347+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:19:38.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.373+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:19:38.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.402+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:19:38.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.418+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:19:38.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:19:38.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.455+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:19:38.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.456+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:19:38.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:19:38.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.486+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:19:38.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 2 16 29226 29210 912.715 932.938 0.000971771 0.00108101 2024-04-20T02:19:38.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.527+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:19:38.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.541+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:19:38.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.593+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:19:38.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.657+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:19:38.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.666+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:19:38.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.666+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:19:38.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.692+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:19:38.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.733+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:19:38.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.748+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:19:38.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.765+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:19:38.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.804+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:19:38.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.812+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:19:38.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.830+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:19:38.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.855+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:19:38.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.874+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:19:38.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.891+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:19:38.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.891+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:19:38.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.917+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:19:38.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.933+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:19:38.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.942+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:19:38.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.969+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:19:38.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:19:38.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:38.986+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:19:39.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.019+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:19:39.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.035+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:19:39.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.054+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:19:39.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.055+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:19:39.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.077+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:19:39.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.088+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:19:39.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.106+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:19:39.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.123+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:19:39.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.145+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:19:39.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:19:39.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.151+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:19:39.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.170+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:19:39.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.186+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:19:39.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:19:39.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:19:39.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.274+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:19:39.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.279+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:19:39.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.298+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:19:39.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.307+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:19:39.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.315+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:19:39.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:19:39.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.372+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:19:39.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.378+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:19:39.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.395+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:19:39.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.431+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:19:39.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:19:39.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.446+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:19:39.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:19:39.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.478+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:19:39.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:19:39.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 3 16 44017 44001 916.591 924.438 0.000806161 0.00107632 2024-04-20T02:19:39.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.531+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:19:39.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:19:39.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.560+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:19:39.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.560+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:19:39.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.574+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:19:39.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.604+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:19:39.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.638+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:19:39.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.648+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:19:39.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.650+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:19:39.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.665+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:19:39.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.694+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:19:39.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.702+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:19:39.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.708+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:19:39.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.733+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:19:39.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.757+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:19:39.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.762+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:19:39.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.787+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:39.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.810+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:19:39.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.833+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:19:39.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.857+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:19:39.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.860+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:19:39.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.873+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:19:39.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:19:39.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:19:39.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.914+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:19:39.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.962+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:19:39.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:19:39.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.982+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:19:39.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:39.995+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:19:40.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.043+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:19:40.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.069+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:19:40.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.095+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:19:40.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.131+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:19:40.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.154+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:19:40.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.170+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:19:40.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.178+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:19:40.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.179+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:19:40.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.219+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:19:40.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.224+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:19:40.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:19:40.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:19:40.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.278+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:19:40.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.304+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:19:40.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.328+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:19:40.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.339+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:19:40.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.388+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:19:40.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.391+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:19:40.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.422+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:19:40.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.433+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:19:40.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:19:40.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.463+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:19:40.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.486+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:19:40.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.508+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:19:40.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 4 16 58911 58895 920.142 930.875 0.000998299 0.001072 2024-04-20T02:19:40.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.541+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:19:40.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.554+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:19:40.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.584+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:19:40.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.599+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:19:40.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.607+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:19:40.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.622+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:19:40.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.640+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:19:40.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.645+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:19:40.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.646+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:19:40.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.684+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:19:40.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.705+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:19:40.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.719+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:19:40.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.722+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:19:40.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.739+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:19:40.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.756+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:19:40.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:19:40.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.792+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:19:40.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.820+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:19:40.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.838+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:19:40.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.850+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:19:40.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.881+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:19:40.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.895+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:19:40.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.917+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:19:40.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.929+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:19:40.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.938+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:19:40.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.967+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:19:40.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.973+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:19:40.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:40.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:19:41.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.021+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:19:41.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.040+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:19:41.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:19:41.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.091+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:19:41.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.104+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:19:41.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.105+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:19:41.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.128+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:41.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.135+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:19:41.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.153+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:19:41.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.158+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:19:41.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.181+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:19:41.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.184+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:41.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.200+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:19:41.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.231+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:19:41.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.249+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:19:41.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.289+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:19:41.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:19:41.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.307+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:19:41.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.335+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:19:41.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.337+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:19:41.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.371+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:19:41.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.375+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:19:41.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.385+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:19:41.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.403+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:19:41.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.424+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:19:41.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:19:41.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.470+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:19:41.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.491+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:19:41.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.495+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:19:41.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.496+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:19:41.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 5 16 73736 73720 921.411 926.562 0.00102864 0.00107016 2024-04-20T02:19:41.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.547+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:19:41.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.553+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:19:41.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:19:41.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.594+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:19:41.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:19:41.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.627+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:19:41.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.635+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:19:41.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.645+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:19:41.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.671+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:19:41.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:19:41.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.710+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:19:41.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.713+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:19:41.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.720+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:19:41.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.745+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:19:41.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:19:41.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.770+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:19:41.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.771+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:19:41.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:19:41.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.783+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:19:41.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.809+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:19:41.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.848+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:19:41.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:19:41.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.865+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:19:41.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.874+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:19:41.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.900+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:19:41.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.912+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:19:41.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.937+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:19:41.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.963+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:19:41.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.964+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:19:41.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:41.965+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:19:42.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.005+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:19:42.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.023+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:19:42.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.043+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:19:42.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.055+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:19:42.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.062+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:19:42.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.069+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:19:42.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.112+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:19:42.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.163+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:19:42.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.165+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:19:42.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.189+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:19:42.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.198+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:19:42.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:19:42.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.259+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:19:42.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.272+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:19:42.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.276+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:19:42.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.278+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:19:42.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.298+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:19:42.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.306+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:19:42.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.324+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:19:42.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.332+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:19:42.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.333+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:42.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.352+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:19:42.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.390+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:42.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.405+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:19:42.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.428+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:19:42.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.436+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:19:42.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:19:42.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.462+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:19:42.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.488+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:19:42.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.492+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:19:42.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 6 16 88338 88322 919.934 912.625 0.00104336 0.00107232 2024-04-20T02:19:42.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:19:42.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.554+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:19:42.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.562+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:19:42.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:19:42.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.616+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:19:42.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.625+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:19:42.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.635+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:19:42.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.692+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:19:42.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.694+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:19:42.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.734+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:19:42.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.754+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:19:42.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.773+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:19:42.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:19:42.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.788+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:19:42.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.799+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:19:42.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.829+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:19:42.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.840+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:19:42.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.845+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:19:42.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:19:42.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.875+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:19:42.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.894+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:19:42.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.901+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:19:42.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.926+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:19:42.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.960+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:19:42.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.970+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:19:42.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:42.985+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:19:43.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.006+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:19:43.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.033+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:19:43.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.044+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:19:43.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.055+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:19:43.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.064+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:19:43.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.081+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:19:43.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:19:43.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.135+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:19:43.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.149+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:19:43.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:19:43.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.190+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:19:43.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:19:43.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:19:43.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.226+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:19:43.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.230+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:19:43.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.247+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:19:43.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.271+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:19:43.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.274+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:19:43.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.305+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:19:43.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.322+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:19:43.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.342+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:19:43.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.352+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:19:43.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.360+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:19:43.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.370+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:19:43.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.391+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:19:43.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.395+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:19:43.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.421+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:19:43.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.446+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:19:43.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.449+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:19:43.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.456+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:19:43.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.478+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:19:43.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:19:43.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.504+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:19:43.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:19:43.518 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 7 16 102909 102893 918.603 910.688 0.000531791 0.00107372 2024-04-20T02:19:43.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.541+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:19:43.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.555+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:19:43.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.575+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:19:43.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.581+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:19:43.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:19:43.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.603+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:19:43.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.611+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:19:43.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.632+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:19:43.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.648+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:19:43.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.657+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:19:43.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.672+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:19:43.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:19:43.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.699+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:19:43.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.701+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:19:43.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.729+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:19:43.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.746+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:19:43.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.801+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:19:43.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.837+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:19:43.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.843+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:19:43.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:19:43.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.862+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:19:43.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.934+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:19:43.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.936+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:19:43.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.955+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:19:43.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:43.966+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:19:44.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.000+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:19:44.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.013+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:19:44.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.046+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:19:44.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.047+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:19:44.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:19:44.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.068+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:19:44.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.095+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:19:44.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.113+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:19:44.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:19:44.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.145+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:19:44.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.148+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:19:44.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.164+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:19:44.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.170+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:19:44.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.194+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:19:44.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.206+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:19:44.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.220+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:19:44.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.241+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:19:44.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.246+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:19:44.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:19:44.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:19:44.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.293+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:19:44.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.303+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:19:44.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:19:44.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.353+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:19:44.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:19:44.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.388+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:19:44.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.389+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:19:44.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.399+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:19:44.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.402+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:19:44.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.435+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:19:44.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.458+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:19:44.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.482+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:19:44.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.513+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:19:44.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 8 16 117648 117632 918.917 921.188 0.00108991 0.00107346 2024-04-20T02:19:44.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.538+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:19:44.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.559+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:19:44.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.589+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:19:44.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:19:44.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.657+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:19:44.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.677+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:19:44.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:19:44.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.701+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:19:44.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.702+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:19:44.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:19:44.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.750+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:19:44.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.785+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:19:44.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.814+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:19:44.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:19:44.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.831+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:19:44.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.852+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:19:44.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:19:44.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.873+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:19:44.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.884+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:19:44.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:19:44.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.917+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:19:44.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.947+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:19:44.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:19:44.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.978+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:19:44.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:19:44.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:44.993+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:19:45.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.032+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:19:45.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.040+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:19:45.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.153+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:19:45.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.155+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:19:45.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.162+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:19:45.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.184+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:19:45.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.214+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:19:45.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.218+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:19:45.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.230+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:19:45.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.241+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:19:45.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.255+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:19:45.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.274+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:19:45.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.275+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:19:45.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.302+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:19:45.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:19:45.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.326+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:19:45.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:19:45.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:19:45.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.388+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:19:45.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.396+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:19:45.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.414+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:19:45.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.423+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:19:45.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.438+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:19:45.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.499+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:19:45.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.512+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:19:45.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 9 16 131087 131071 910.134 839.938 0.00100298 0.00108386 2024-04-20T02:19:45.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.529+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:19:45.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.540+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:19:45.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.562+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:19:45.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.566+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:19:45.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.572+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:19:45.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.602+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:19:45.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.624+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:19:45.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.632+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:19:45.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:19:45.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.655+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:19:45.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.671+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:19:45.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.679+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:19:45.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.683+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:19:45.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.725+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:19:45.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.732+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:19:45.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.742+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:19:45.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.778+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:19:45.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.796+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:19:45.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.797+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:19:45.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:19:45.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.875+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:19:45.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.895+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:19:45.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.896+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:19:45.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.902+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:19:45.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.919+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:19:45.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.938+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:19:45.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:19:45.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.961+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:19:45.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.961+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:19:45.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:19:45.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:45.993+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:19:46.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.012+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:19:46.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.024+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:19:46.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.027+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:46.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.032+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:19:46.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.065+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:19:46.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.070+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:19:46.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.095+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:19:46.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.109+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:19:46.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.131+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:19:46.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.134+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:19:46.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:19:46.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.169+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:19:46.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.173+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:19:46.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.190+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:19:46.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.226+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:19:46.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.240+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:19:46.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.260+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:19:46.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.265+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:19:46.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.275+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:19:46.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.298+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:19:46.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:19:46.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.331+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:19:46.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.333+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:19:46.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.334+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:19:46.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.350+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:19:46.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.402+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:19:46.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.403+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:19:46.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.434+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:19:46.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.450+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:19:46.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:19:46.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.499+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:19:46.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.500+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:19:46.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 10 16 145534 145518 909.407 902.938 0.00100622 0.0010848 2024-04-20T02:19:46.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.524+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:19:46.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:19:46.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.548+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:19:46.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.562+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:19:46.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.568+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:19:46.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.590+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:19:46.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:19:46.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.686+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:19:46.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.711+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:19:46.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.725+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:19:46.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.738+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:19:46.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.742+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:19:46.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.771+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:19:46.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.792+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:19:46.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.794+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:19:46.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.800+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:19:46.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.830+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:19:46.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.842+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:19:46.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.860+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:19:46.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.871+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:19:46.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.896+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:19:46.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:19:46.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.913+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:19:46.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.914+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:19:46.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.938+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:19:46.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.963+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:19:46.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.987+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:19:46.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.993+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:19:46.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:46.995+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:19:47.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.002+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:19:47.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.036+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:19:47.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.043+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:19:47.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.050+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:19:47.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.052+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:19:47.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.078+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:19:47.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.087+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:19:47.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.131+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:19:47.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.154+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:19:47.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.172+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:19:47.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.204+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:19:47.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.206+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:19:47.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.233+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:19:47.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.247+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:19:47.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.260+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:19:47.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:19:47.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:19:47.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.296+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:19:47.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:19:47.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:19:47.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.372+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:19:47.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.403+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:19:47.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.417+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:19:47.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.418+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:19:47.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.431+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:19:47.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.455+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:19:47.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.460+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:19:47.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.482+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:19:47.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.505+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:19:47.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.510+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:19:47.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 11 16 160162 160146 909.841 914.25 0.000803028 0.00108442 2024-04-20T02:19:47.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.525+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:19:47.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.549+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:19:47.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.552+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:19:47.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.585+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:19:47.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.591+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:19:47.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.594+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:19:47.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:19:47.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.650+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:19:47.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.659+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:19:47.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:19:47.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.680+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:19:47.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.691+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:19:47.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.706+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:19:47.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:19:47.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.734+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:19:47.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.735+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:19:47.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.755+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:19:47.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:19:47.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.786+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:19:47.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.836+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:19:47.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.845+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:19:47.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.849+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:19:47.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.856+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:19:47.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.890+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:19:47.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.890+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:19:47.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.919+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:19:47.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:19:47.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.986+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:19:47.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:47.993+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:19:48.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.017+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:19:48.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:19:48.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.044+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:19:48.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.061+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:19:48.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.077+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:19:48.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.081+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:19:48.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.087+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:19:48.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.103+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:19:48.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.106+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:19:48.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.113+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:19:48.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.170+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:19:48.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.195+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:19:48.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.208+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:19:48.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.209+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:19:48.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:19:48.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.247+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:19:48.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.269+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:19:48.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.270+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:19:48.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:19:48.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.295+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:19:48.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.329+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:19:48.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.333+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:19:48.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.368+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:19:48.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.394+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:19:48.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.408+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:19:48.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.420+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:19:48.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.422+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:19:48.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.430+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:19:48.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.446+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:19:48.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.479+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:19:48.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.510+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:19:48.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 12 16 174711 174695 909.79 909.312 0.000794615 0.00108446 2024-04-20T02:19:48.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.545+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:19:48.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:19:48.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.570+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:19:48.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.579+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:19:48.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.596+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:19:48.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.604+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:19:48.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.615+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:19:48.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.639+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:19:48.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.684+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:19:48.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.704+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:19:48.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:19:48.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.718+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:19:48.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.731+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:19:48.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.742+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:19:48.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.768+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:19:48.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.801+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:19:48.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.826+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:19:48.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.841+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:19:48.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.849+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:19:48.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.854+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:19:48.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.856+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:19:48.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.885+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:48.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.915+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:19:48.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.924+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:19:48.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:19:48.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.952+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:19:48.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.976+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:19:48.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.986+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:19:48.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:48.990+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:19:49.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.009+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:19:49.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.011+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:19:49.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:19:49.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.050+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:19:49.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.064+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:19:49.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.088+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:19:49.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.116+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:19:49.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.132+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:19:49.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.145+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:19:49.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.165+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:19:49.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.190+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:19:49.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:19:49.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.232+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:19:49.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.247+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:19:49.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.253+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:19:49.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.267+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:19:49.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.267+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:19:49.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.301+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:19:49.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.310+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:19:49.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.318+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:19:49.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.327+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:19:49.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.359+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:19:49.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.387+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:19:49.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.396+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:19:49.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:19:49.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.409+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:19:49.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.416+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:19:49.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.435+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:19:49.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.445+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:19:49.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.459+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:19:49.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.469+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:19:49.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:19:49.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.498+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:19:49.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.501+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:19:49.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.516+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:19:49.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 13 15 189244 189229 909.675 908.375 0.00252781 0.00108458 2024-04-20T02:19:49.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.536+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:19:49.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:19:49.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.620+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:19:49.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.639+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:19:49.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.654+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:19:49.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.664+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:19:49.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.668+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:19:49.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.672+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:19:49.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.674+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:19:49.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.714+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:19:49.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.719+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:19:49.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.791+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:19:49.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.822+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:19:49.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.845+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:19:49.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.867+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:19:49.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.872+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:19:49.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.897+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:19:49.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.899+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:19:49.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.920+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:19:49.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:19:49.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:19:49.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.963+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:19:49.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.980+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:19:49.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:49.995+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:19:50.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.014+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:19:50.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.051+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:19:50.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.060+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:19:50.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.095+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:19:50.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.116+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:19:50.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.229+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:19:50.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.237+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:19:50.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.257+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:19:50.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.261+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:19:50.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.296+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:19:50.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.301+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:19:50.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.327+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:19:50.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.347+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:19:50.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.352+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:19:50.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.374+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:19:50.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.380+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:19:50.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.390+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:19:50.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.419+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:19:50.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.423+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:19:50.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.470+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:19:50.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.480+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:19:50.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.482+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:19:50.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:19:50.519 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 14 16 202670 202654 904.606 839.062 0.00116814 0.00109077 2024-04-20T02:19:50.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.523+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:19:50.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.538+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:19:50.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.553+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:19:50.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:19:50.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.633+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:19:50.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.642+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:19:50.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:19:50.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.656+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:19:50.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.681+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:19:50.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.689+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:19:50.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.715+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:19:50.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.739+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:19:50.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.751+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:19:50.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:19:50.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:19:50.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:19:50.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.840+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:19:50.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.842+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:19:50.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.867+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:19:50.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.876+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:19:50.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.883+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:19:50.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.889+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:19:50.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:19:50.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.904+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:19:50.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.913+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:19:50.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.930+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:19:50.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.938+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:19:50.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.955+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:19:50.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:19:50.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.974+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:19:50.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:50.992+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:19:51.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.005+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:19:51.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.007+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:19:51.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.010+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:19:51.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.036+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:19:51.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:19:51.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.053+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:19:51.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.089+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:19:51.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.093+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:19:51.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.099+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:19:51.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.111+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:19:51.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.129+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:19:51.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.146+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:19:51.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:19:51.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.162+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:19:51.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.189+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:19:51.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.209+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:19:51.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.228+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:19:51.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.232+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:19:51.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.260+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:19:51.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.272+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:19:51.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.296+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:19:51.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.298+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:19:51.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.322+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:19:51.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.324+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:19:51.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:19:51.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.356+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:19:51.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.389+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:19:51.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.414+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:19:51.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:19:51.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.424+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:19:51.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.465+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:19:51.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.476+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:19:51.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.479+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:19:51.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.494+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:19:51.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.510+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:19:51.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:19:51.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 15 16 217223 217207 904.932 909.562 0.000761821 0.00109031 2024-04-20T02:19:51.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.527+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:19:51.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.531+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:19:51.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.557+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:19:51.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.576+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:19:51.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.578+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:19:51.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:19:51.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:19:51.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.623+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:19:51.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.671+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:19:51.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.679+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:19:51.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.707+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:19:51.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:19:51.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.736+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:19:51.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.741+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:19:51.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.745+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:19:51.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:19:51.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.804+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:19:51.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.821+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:19:51.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.835+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:19:51.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.844+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:19:51.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.868+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:19:51.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:19:51.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.902+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:19:51.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:19:51.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.928+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:19:51.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.946+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:19:51.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.946+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:19:51.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.959+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:19:51.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.988+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:19:51.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:51.992+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:19:52.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.031+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:19:52.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.053+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:19:52.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.081+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:19:52.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.119+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:19:52.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.137+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:19:52.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.144+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:19:52.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.167+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:19:52.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.184+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:19:52.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.196+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:19:52.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.206+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:19:52.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.227+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:19:52.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.241+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:19:52.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.251+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:19:52.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.253+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:19:52.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.264+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:19:52.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.294+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:19:52.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.307+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:19:52.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.311+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:19:52.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.389+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:19:52.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.392+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:19:52.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.441+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:19:52.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.456+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:19:52.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.461+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:19:52.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.478+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:19:52.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:19:52.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.516+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:19:52.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 16 16 232085 232069 906.419 928.875 0.00108992 0.00108857 2024-04-20T02:19:52.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.527+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:19:52.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.548+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:19:52.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:19:52.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.588+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:19:52.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:19:52.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.611+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:19:52.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.643+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:19:52.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.663+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:19:52.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.664+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:19:52.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.675+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:19:52.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:19:52.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.699+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:19:52.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.723+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:19:52.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.770+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:19:52.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.802+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:19:52.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.816+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:19:52.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.833+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:19:52.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.840+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:19:52.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.856+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:19:52.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.873+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:19:52.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.878+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:19:52.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.919+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:19:52.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.931+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:19:52.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.941+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:19:52.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.965+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:19:52.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.981+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:19:52.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:52.997+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:19:53.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.014+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:19:53.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.022+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:19:53.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.047+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:19:53.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.062+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:19:53.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.070+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:19:53.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.090+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:19:53.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.101+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:19:53.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.111+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:19:53.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.137+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:19:53.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.170+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:19:53.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.176+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:19:53.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.190+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:19:53.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.204+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:19:53.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:19:53.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.232+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:19:53.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.269+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:19:53.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.281+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:19:53.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.292+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:19:53.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.297+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:19:53.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.312+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:19:53.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.320+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:19:53.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.331+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:19:53.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.356+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:19:53.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.358+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:19:53.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:19:53.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.413+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:19:53.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.424+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:19:53.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:19:53.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:19:53.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.460+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:19:53.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.495+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:19:53.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.518+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:19:53.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 17 16 246810 246794 907.232 920.312 0.000795137 0.00108764 2024-04-20T02:19:53.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.527+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:19:53.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.530+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:19:53.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.552+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:19:53.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.607+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:19:53.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.626+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:19:53.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.653+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:19:53.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.657+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:19:53.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:19:53.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.672+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:19:53.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.691+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:19:53.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.736+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:19:53.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.771+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:19:53.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:19:53.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.791+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:19:53.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.805+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:19:53.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.833+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:19:53.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.880+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:19:53.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.887+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:19:53.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.890+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:19:53.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:19:53.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:19:53.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.926+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:19:53.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.938+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:19:53.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.939+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:19:53.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.954+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:19:53.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:19:53.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:53.993+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:19:54.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.058+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:19:54.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.105+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:19:54.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.118+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:19:54.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.125+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:19:54.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.131+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:19:54.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.185+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:19:54.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.216+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:19:54.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:19:54.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.239+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:19:54.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:19:54.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.293+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:19:54.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.313+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:19:54.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.325+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:19:54.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:19:54.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.368+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:19:54.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.369+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:19:54.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.388+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:19:54.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.397+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:19:54.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.405+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:19:54.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.428+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:19:54.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.465+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:19:54.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:19:54.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:19:54.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.485+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:19:54.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:19:54.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.511+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:19:54.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 18 16 261576 261560 908.094 922.875 0.00322527 0.00108649 2024-04-20T02:19:54.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.530+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:19:54.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.559+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:19:54.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.572+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:19:54.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.573+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:19:54.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.590+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:19:54.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.629+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:19:54.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.642+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:19:54.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.660+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:19:54.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.675+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:19:54.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.683+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:19:54.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.702+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:19:54.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.715+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:19:54.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.742+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:19:54.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.767+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:19:54.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:19:54.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.790+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:19:54.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.798+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:19:54.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.811+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:19:54.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.828+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:19:54.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:19:54.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.851+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:19:54.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.884+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:19:54.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:19:54.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:19:54.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:19:54.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:19:54.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.948+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:19:54.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.952+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:19:54.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.972+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:19:54.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:54.993+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:19:55.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:19:55.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.056+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:19:55.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.073+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:19:55.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.098+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:19:55.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.100+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:19:55.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.128+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:19:55.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.131+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:19:55.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.152+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:19:55.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.152+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:19:55.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.184+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:19:55.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:19:55.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:19:55.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.232+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:19:55.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.240+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:19:55.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.256+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:19:55.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.283+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:19:55.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.304+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:19:55.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.309+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:19:55.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:19:55.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.350+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:19:55.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.367+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:19:55.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.380+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:19:55.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.384+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:19:55.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.399+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:19:55.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.418+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:19:55.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.455+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:19:55.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.466+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:19:55.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.470+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:19:55.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.495+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:19:55.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.507+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:19:55.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 19 15 276285 276270 908.684 919.375 0.000592784 0.00108592 2024-04-20T02:19:55.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.539+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:19:55.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.549+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:19:55.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.558+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:19:55.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.573+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:19:55.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.593+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:19:55.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.610+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:19:55.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.624+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:19:55.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.642+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:19:55.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.646+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:19:55.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.657+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:19:55.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.668+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:19:55.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.682+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:19:55.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.700+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:19:55.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.701+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:19:55.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.725+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:19:55.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.754+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:19:55.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.783+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:19:55.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:19:55.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.785+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:19:55.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.836+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:19:55.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.846+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:19:55.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.855+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:19:55.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.868+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:19:55.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.892+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:19:55.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.895+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:19:55.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:19:55.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.930+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:19:55.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.977+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:19:55.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.985+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:19:55.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:55.990+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:19:56.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.011+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:19:56.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.012+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:19:56.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.055+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:19:56.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:19:56.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.096+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:19:56.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.121+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:19:56.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.139+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:19:56.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.150+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:19:56.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.159+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:19:56.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.161+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:19:56.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.189+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:19:56.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.203+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:19:56.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.208+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:19:56.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.220+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:19:56.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.226+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:19:56.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.232+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:19:56.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.241+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:19:56.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.252+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:19:56.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.270+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:19:56.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.297+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:19:56.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:56.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.320+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:19:56.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.329+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:19:56.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.336+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:19:56.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:19:56.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:19:56.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.373+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:19:56.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.399+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:19:56.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.400+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:19:56.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.415+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:19:56.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.426+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:19:56.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:19:56.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.442+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:19:56.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.443+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:19:56.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.482+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:19:56.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.485+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:19:56.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.493+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:19:56.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:19:56.521960+0000 min lat: 0.000260714 max lat: 0.0996019 avg lat: 0.00108579 2024-04-20T02:19:56.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:19:56.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 20 16 290868 290852 908.815 911.375 0.00138664 0.00108579 2024-04-20T02:19:56.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.523+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:19:56.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.526+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:19:56.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.537+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:19:56.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.543+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:19:56.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.557+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:19:56.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.565+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:19:56.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.580+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:19:56.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.597+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:19:56.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.620+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:19:56.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.624+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:19:56.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.643+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:19:56.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:19:56.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.665+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:19:56.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.674+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:19:56.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.697+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:19:56.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.698+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:19:56.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.704+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:19:56.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.719+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:19:56.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.745+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:19:56.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.746+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:56.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.755+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:19:56.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.775+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:19:56.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.779+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:19:56.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:19:56.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.803+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:19:56.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.817+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:19:56.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.837+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:56.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.855+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:19:56.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.856+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:19:56.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.883+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:19:56.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.885+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:19:56.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.892+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:19:56.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.944+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:19:56.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.953+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:19:56.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.964+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:56.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:56.992+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:19:56.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.000+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:19:57.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.029+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:19:57.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.038+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:19:57.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.061+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:19:57.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.070+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:19:57.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.078+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:19:57.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.085+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:19:57.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.092+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:19:57.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.093+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:19:57.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.118+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:19:57.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:19:57.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.148+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:19:57.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:19:57.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.176+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:19:57.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.179+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:19:57.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.194+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:19:57.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.219+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:19:57.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.228+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:19:57.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.259+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:19:57.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.265+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:19:57.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.281+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:19:57.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.308+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:19:57.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.309+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:19:57.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.352+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:19:57.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.358+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:19:57.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.377+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:19:57.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.428+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:19:57.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.446+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:19:57.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.447+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:19:57.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.480+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:19:57.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.484+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:19:57.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:19:57.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.508+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:19:57.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.510+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:19:57.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 21 15 305394 305379 908.761 907.938 0.0014216 0.00108579 2024-04-20T02:19:57.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.528+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:19:57.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.528+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:19:57.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.585+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:19:57.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.598+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:19:57.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.617+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:19:57.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.634+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:19:57.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.648+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:19:57.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.649+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:19:57.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.660+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:19:57.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.697+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:19:57.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.725+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:19:57.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.744+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:19:57.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.797+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:19:57.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.813+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:19:57.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.839+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:19:57.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.883+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:19:57.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.928+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:19:57.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.933+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:19:57.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:57.988+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:19:57.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.001+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:19:58.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.013+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:19:58.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.034+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:19:58.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.040+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:19:58.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.067+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:19:58.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.071+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:19:58.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.119+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:19:58.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.132+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:19:58.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.148+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:19:58.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.168+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:19:58.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.179+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:19:58.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.218+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:19:58.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.235+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:19:58.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.246+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:19:58.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.258+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:19:58.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.270+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:19:58.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.279+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:19:58.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.286+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:19:58.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.307+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:19:58.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.329+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:19:58.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.373+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:19:58.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.374+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:19:58.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:19:58.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.402+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:19:58.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:19:58.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.447+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:19:58.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.462+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:19:58.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.474+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:19:58.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.480+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:19:58.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.482+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:19:58.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.498+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:19:58.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:19:58.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 22 15 320280 320265 909.74 930.375 0.000534071 0.00108461 2024-04-20T02:19:58.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.527+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:19:58.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.529+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:19:58.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.547+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:19:58.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.558+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:19:58.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.611+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:19:58.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.615+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:19:58.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.620+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:19:58.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:19:58.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.673+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:19:58.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.677+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:19:58.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:19:58.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.700+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:19:58.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.708+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:19:58.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.727+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:19:58.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.754+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:19:58.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.764+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:19:58.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.770+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:19:58.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.777+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:19:58.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.789+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:19:58.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.811+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:19:58.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:19:58.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.842+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:19:58.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:19:58.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.902+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:19:58.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.914+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:19:58.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.922+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:19:58.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.945+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:19:58.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:19:58.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.949+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:19:58.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.980+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:19:58.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.990+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:19:58.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:58.994+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:19:59.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.020+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:19:59.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:19:59.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.057+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:19:59.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.057+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:19:59.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.057+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:19:59.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.092+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:19:59.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.119+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:19:59.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:19:59.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.137+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:19:59.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.159+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:19:59.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.177+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:19:59.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.245+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:19:59.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.273+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:19:59.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.321+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:19:59.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.361+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:19:59.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:19:59.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:19:59.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.435+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:19:59.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.454+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:19:59.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.474+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:19:59.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.519+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:19:59.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.521+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:19:59.520 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 23 16 335167 335151 910.634 930.375 0.000698422 0.00108358 2024-04-20T02:19:59.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.565+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:19:59.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:19:59.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.597+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:19:59.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.607+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:19:59.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.617+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:19:59.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.641+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:19:59.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.663+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:19:59.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.682+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:19:59.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.683+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:19:59.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.731+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:19:59.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.734+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:19:59.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.762+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:19:59.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:19:59.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.788+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:19:59.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.788+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:19:59.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.822+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:19:59.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:19:59.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.857+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:19:59.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.885+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:19:59.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.950+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:19:59.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.960+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:19:59.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.974+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:19:59.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.983+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:19:59.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.985+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:19:59.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.987+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:19:59.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:19:59.999+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:00.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.036+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:20:00.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.062+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:00.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.066+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:20:00.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:00.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:20:00.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.112+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:20:00.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.128+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:00.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.215+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:20:00.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.241+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:20:00.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.247+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:20:00.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.258+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:00.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.285+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:20:00.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.285+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:00.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.315+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:20:00.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.326+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:20:00.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:20:00.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.359+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:20:00.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.366+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:00.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.368+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:00.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:20:00.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.419+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:20:00.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.456+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:00.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.506+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:20:00.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 24 16 349386 349370 909.713 888.688 0.000638249 0.00108469 2024-04-20T02:20:00.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.528+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:20:00.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.568+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:20:00.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:20:00.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.608+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:20:00.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.642+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:20:00.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.673+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:20:00.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.679+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:20:00.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.703+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:20:00.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.703+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:20:00.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.726+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:20:00.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.757+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:20:00.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.777+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:20:00.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.800+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:20:00.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.833+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:00.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.842+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:00.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.878+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:20:00.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.903+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:20:00.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.919+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:20:00.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.945+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:20:00.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.949+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:20:00.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:20:00.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.977+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:20:00.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:00.988+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:20:01.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.004+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:20:01.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:20:01.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.083+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:20:01.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.102+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:20:01.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.131+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:01.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.136+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:01.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.137+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:20:01.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.185+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:20:01.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.225+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:01.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.225+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:01.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.239+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:20:01.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.258+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:20:01.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.282+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:20:01.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.293+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:20:01.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.322+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:20:01.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.327+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:20:01.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.347+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:20:01.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:01.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.386+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:20:01.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.402+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:20:01.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.414+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:01.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:20:01.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:01.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.432+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:20:01.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.455+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:01.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.475+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:20:01.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.486+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:20:01.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.489+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:20:01.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.510+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:20:01.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 25 15 363244 363229 907.968 866.188 0.000738507 0.00108677 2024-04-20T02:20:01.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.558+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:20:01.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.570+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:20:01.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.580+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:20:01.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.620+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:20:01.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.634+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:01.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.645+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:20:01.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.653+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:20:01.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:20:01.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.681+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:20:01.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.706+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:20:01.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.734+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:20:01.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.756+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:20:01.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:01.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.800+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:01.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.812+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:01.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.828+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:20:01.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.875+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:01.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.912+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:20:01.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.937+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:20:01.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.941+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:20:01.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.976+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:20:01.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:01.982+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:20:02.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.003+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:20:02.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.010+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:20:02.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.051+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:20:02.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.052+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:02.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.065+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:20:02.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.110+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:02.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:02.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.147+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:20:02.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.164+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:02.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.180+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:20:02.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.183+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:02.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.218+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:20:02.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.237+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:20:02.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.265+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:20:02.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:20:02.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.295+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:20:02.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.318+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:02.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.318+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:20:02.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.337+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:02.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.356+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:02.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.364+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:20:02.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.377+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:20:02.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.383+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:02.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.437+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:20:02.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:02.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.464+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:20:02.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.480+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:02.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 26 15 378013 377998 908.546 923.062 0.00113724 0.00108609 2024-04-20T02:20:02.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.537+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:20:02.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.559+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:20:02.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.593+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:02.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.596+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:20:02.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.634+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:20:02.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.641+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:20:02.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.661+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:20:02.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.692+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:02.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.704+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:20:02.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.732+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:20:02.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.738+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:20:02.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.743+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:20:02.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.749+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:20:02.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.765+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:20:02.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.785+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:02.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.826+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:20:02.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.838+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:20:02.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.858+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:20:02.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:02.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:20:02.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:20:02.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.916+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:20:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.933+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:02.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.934+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:20:02.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:20:02.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.957+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:20:02.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.969+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:20:02.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:02.975+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:20:03.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.010+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:20:03.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.015+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:20:03.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:20:03.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.082+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:20:03.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.094+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:20:03.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:20:03.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.174+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:20:03.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:03.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.197+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:20:03.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.223+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:03.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.239+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:20:03.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.256+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:20:03.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.291+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:20:03.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.318+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:20:03.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.323+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:20:03.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.328+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:03.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.340+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:20:03.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.371+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:20:03.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.382+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:03.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.395+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:03.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:20:03.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.460+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:20:03.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.488+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:03.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.501+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:20:03.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 27 16 392835 392819 909.201 926.312 0.000638721 0.00108531 2024-04-20T02:20:03.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.540+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:20:03.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.577+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:20:03.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:03.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.600+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:20:03.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.611+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:20:03.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:20:03.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:20:03.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.662+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:03.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:20:03.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.675+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:03.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.691+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:20:03.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.706+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:20:03.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.716+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:20:03.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.730+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:20:03.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.762+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:20:03.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.764+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:03.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.765+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:20:03.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.813+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:03.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.818+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:20:03.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.829+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:03.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.842+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:20:03.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.853+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:03.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.854+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:20:03.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.862+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:03.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.889+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:03.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:20:03.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.898+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:20:03.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.917+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:20:03.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.943+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:20:03.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.946+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:03.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:03.994+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:04.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.000+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:20:04.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.003+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:04.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.012+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:20:04.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.021+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:04.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.042+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:20:04.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.070+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:20:04.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.075+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:20:04.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.107+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:20:04.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.113+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:04.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:20:04.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.159+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:20:04.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.176+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:04.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.178+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:20:04.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.196+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:20:04.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:20:04.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.217+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:20:04.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.275+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:20:04.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.322+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:20:04.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.342+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:20:04.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.358+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:20:04.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.375+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:20:04.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.417+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:20:04.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.445+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:20:04.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.472+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:04.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.490+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:20:04.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.511+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:20:04.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.513+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:20:04.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 28 16 407471 407455 909.397 914.75 0.00072002 0.00108503 2024-04-20T02:20:04.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.572+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:20:04.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:20:04.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.591+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:20:04.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.624+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:20:04.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.641+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:04.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:04.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.669+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:20:04.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.679+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:04.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:20:04.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.709+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:20:04.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.726+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:04.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.741+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:04.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:20:04.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.772+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:20:04.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.777+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:20:04.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.799+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:20:04.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.812+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:20:04.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.832+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:04.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.856+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:20:04.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:04.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.861+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:04.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.886+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:20:04.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.891+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:20:04.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.910+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:04.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.939+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:20:04.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.947+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:20:04.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.960+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:20:04.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.971+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:20:04.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.973+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:20:04.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:04.994+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:20:05.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.023+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:20:05.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.024+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:20:05.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.046+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:20:05.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:20:05.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.057+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:05.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.070+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:05.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:20:05.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.133+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:20:05.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.138+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:20:05.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.147+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:20:05.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.156+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:20:05.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.234+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:05.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:20:05.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.275+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:20:05.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.285+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:20:05.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.322+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:20:05.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.335+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:20:05.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.347+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:20:05.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.390+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:20:05.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.398+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:20:05.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.415+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:20:05.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:05.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.445+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:05.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.448+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:20:05.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.463+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:05.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:05.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.502+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:20:05.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 29 16 420854 420838 906.879 836.438 0.000641721 0.00108813 2024-04-20T02:20:05.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.526+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:20:05.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.552+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:20:05.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.568+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:20:05.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.580+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:20:05.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:20:05.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.586+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:20:05.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.637+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:20:05.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.643+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:20:05.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.671+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:20:05.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.686+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:20:05.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:20:05.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.715+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:05.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.731+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:20:05.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:20:05.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:20:05.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.791+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:20:05.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.804+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:20:05.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.805+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:20:05.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.823+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:20:05.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.856+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:20:05.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.894+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:20:05.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:20:05.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.944+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:20:05.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.970+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:20:05.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:05.974+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:20:06.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:20:06.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.022+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:20:06.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.038+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:06.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.191+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:20:06.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.195+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:20:06.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.227+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:20:06.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.277+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:20:06.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.293+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:20:06.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.297+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:20:06.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.314+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:20:06.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.344+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:20:06.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.357+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:20:06.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:20:06.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:20:06.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:20:06.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.406+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:20:06.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.456+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:20:06.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.457+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:20:06.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.488+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:20:06.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.507+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:06.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.507+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:06.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:20:06.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 30 16 434614 434598 905.314 860 0.000831947 0.00109 2024-04-20T02:20:06.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.543+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:06.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.552+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:20:06.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:20:06.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.590+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:20:06.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.594+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:20:06.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.595+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:20:06.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.614+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:20:06.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.662+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:20:06.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.664+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:20:06.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.668+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:06.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.679+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:06.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.706+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:20:06.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.721+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:20:06.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.734+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:20:06.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:20:06.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.763+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:20:06.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.785+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:20:06.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.798+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:20:06.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.814+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:06.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.867+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:20:06.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.893+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:20:06.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.898+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:20:06.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.934+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:20:06.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.957+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:06.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:20:06.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:06.999+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:20:07.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:07.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.021+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:20:07.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.034+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:20:07.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.056+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:20:07.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.091+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:20:07.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.111+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:20:07.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:20:07.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.125+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:20:07.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.166+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:07.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.188+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:20:07.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.189+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:20:07.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.217+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:20:07.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.234+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:20:07.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.246+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:20:07.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.246+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:20:07.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.269+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:07.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.287+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:07.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.293+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:20:07.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.315+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:20:07.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.315+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:07.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.353+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:20:07.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.362+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:07.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:20:07.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.382+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:20:07.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.394+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:20:07.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.406+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:20:07.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.440+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:20:07.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.449+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:07.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.456+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:20:07.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.459+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:20:07.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.475+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:20:07.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.485+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:20:07.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.516+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:20:07.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 31 16 448881 448865 904.873 891.688 0.000899075 0.00109058 2024-04-20T02:20:07.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.542+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:20:07.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.555+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:20:07.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.562+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:07.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.574+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:20:07.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.576+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:20:07.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.583+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:07.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.604+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:20:07.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.612+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:20:07.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.646+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:07.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.679+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:07.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.690+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:20:07.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:20:07.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.713+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:07.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.743+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:20:07.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.752+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:20:07.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.759+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:07.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:07.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.802+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:20:07.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.833+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:20:07.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.856+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:20:07.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.880+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:20:07.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.885+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:20:07.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.907+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:20:07.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.955+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:07.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:07.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:07.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:20:08.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.036+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:20:08.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.045+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:08.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.052+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:08.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.075+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:08.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.075+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:20:08.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.082+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:20:08.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.095+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:20:08.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.115+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:20:08.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.127+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:20:08.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.132+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:20:08.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.143+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:20:08.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.162+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:20:08.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.180+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:20:08.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.190+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:08.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.198+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:20:08.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.212+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:20:08.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.232+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:20:08.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:20:08.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.246+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:20:08.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.273+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:08.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.291+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:08.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.303+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:20:08.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.323+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:20:08.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:20:08.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:20:08.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.361+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:20:08.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.364+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:20:08.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.384+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:08.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.399+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:20:08.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.406+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:20:08.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.423+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:20:08.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.435+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:20:08.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.435+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:20:08.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.485+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:08.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.499+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:08.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.512+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:20:08.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 32 15 463104 463089 904.374 889 0.00040751 0.00109121 2024-04-20T02:20:08.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.525+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:08.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.537+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:08.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.545+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:20:08.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.571+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:20:08.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.606+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:20:08.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.617+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:20:08.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.640+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:20:08.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:20:08.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.686+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:20:08.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.694+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:08.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.729+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:08.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.742+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:20:08.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.754+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:08.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.760+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:20:08.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.795+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:20:08.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.812+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:20:08.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.830+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:20:08.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.847+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:20:08.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.861+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:20:08.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.882+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:20:08.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.901+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:20:08.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.934+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:08.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.948+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:08.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.969+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:20:08.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:08.984+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:20:09.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.001+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:20:09.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.005+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:09.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.025+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:20:09.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.034+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:20:09.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.041+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:09.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.062+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:09.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.086+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:20:09.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:20:09.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:20:09.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.130+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:20:09.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.144+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:09.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.186+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:09.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.199+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:20:09.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.220+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:09.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.227+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:09.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:20:09.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.249+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:20:09.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.261+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:20:09.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:20:09.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.288+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:20:09.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.293+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:09.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.305+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:09.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.335+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:20:09.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.335+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:20:09.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.350+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:20:09.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.377+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:20:09.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.379+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:20:09.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.406+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:20:09.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.413+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:09.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.439+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:09.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.484+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:09.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.493+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:20:09.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.508+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:20:09.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 33 16 477706 477690 904.62 912.562 0.000706546 0.00109092 2024-04-20T02:20:09.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.554+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:20:09.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.561+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:20:09.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:09.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.591+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:20:09.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.611+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:09.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.615+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:20:09.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.626+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:20:09.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.631+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:20:09.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.639+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:20:09.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.663+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:09.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:20:09.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.687+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:20:09.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.703+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:20:09.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.712+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:20:09.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:20:09.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.756+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:20:09.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.764+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:20:09.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.780+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:20:09.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.798+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:20:09.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.813+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:09.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.817+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:20:09.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.834+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:20:09.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:20:09.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.863+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:09.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.870+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:20:09.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.889+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:20:09.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.892+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:09.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:20:09.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.926+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:20:09.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.929+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:20:09.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.942+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:20:09.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.958+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:20:09.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.964+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:20:09.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:20:09.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:09.986+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:20:10.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.012+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:20:10.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:10.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.044+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:10.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.053+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:10.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:10.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.067+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:20:10.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.071+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:20:10.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.140+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:20:10.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.160+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:20:10.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.166+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:10.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.177+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:20:10.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.211+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:20:10.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:20:10.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.227+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:10.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.228+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:20:10.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.255+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:20:10.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.278+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:20:10.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.320+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:20:10.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.321+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:10.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.335+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:20:10.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.337+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:20:10.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.355+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:10.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.394+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:20:10.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.410+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:20:10.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:20:10.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.439+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:20:10.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.468+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:20:10.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.484+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:20:10.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.489+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:20:10.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.504+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:20:10.521 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 34 16 492083 492067 904.44 898.562 0.00111508 0.00109115 2024-04-20T02:20:10.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.522+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:20:10.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.533+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:10.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.555+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:20:10.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.556+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:10.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.585+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:20:10.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.602+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:20:10.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.615+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:20:10.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.636+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:10.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.658+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:10.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.673+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:20:10.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:10.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:10.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:20:10.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.776+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:20:10.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:20:10.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.869+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:20:10.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.894+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:20:10.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.900+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:20:10.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.915+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:20:10.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.925+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:10.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.935+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:20:10.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.940+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:20:10.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.942+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:20:10.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:10.982+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:20:11.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.001+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:11.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.017+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:20:11.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.044+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:11.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.064+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:20:11.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.070+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:20:11.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.084+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:20:11.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.113+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:20:11.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.141+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:20:11.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.153+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:20:11.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.240+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:20:11.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.254+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:20:11.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.257+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:20:11.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.258+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:11.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.277+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:20:11.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.299+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:20:11.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.304+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:20:11.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.345+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:20:11.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.397+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:20:11.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.437+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:20:11.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.465+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:20:11.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.488+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:20:11.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.511+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:11.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 35 16 506403 506387 904.166 895 0.000940173 0.00109144 2024-04-20T02:20:11.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.523+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:20:11.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:20:11.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:20:11.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.542+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:11.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.554+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:20:11.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.557+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:20:11.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.599+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:11.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.605+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:20:11.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.622+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:20:11.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:11.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.682+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:11.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.691+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:20:11.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.724+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:20:11.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.731+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:20:11.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.732+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:11.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.762+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:20:11.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.771+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:11.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.775+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:20:11.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.793+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:20:11.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.803+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:11.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.816+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:20:11.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.842+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:11.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.855+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:20:11.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.875+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:11.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.916+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:20:11.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:20:11.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.968+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:20:11.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.976+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:20:11.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:11.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:11.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:20:12.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.003+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:12.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.047+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:20:12.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:12.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.064+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:12.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.070+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:12.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.113+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:20:12.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.116+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:20:12.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.130+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:20:12.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.147+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:20:12.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.163+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:20:12.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.179+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:12.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.200+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:20:12.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.204+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:20:12.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.215+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:12.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.244+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:20:12.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.256+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:20:12.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.276+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:20:12.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.288+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:12.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.291+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:20:12.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.314+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:20:12.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.329+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:20:12.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.333+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:20:12.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.351+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:20:12.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.406+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:20:12.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.416+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:12.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.436+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:20:12.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.467+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:20:12.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.479+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:12.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.496+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:12.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.503+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:12.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.518+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:20:12.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.521+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:20:12.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 36 15 520921 520906 904.255 907.438 0.000578994 0.00109139 2024-04-20T02:20:12.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.544+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:20:12.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.556+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:20:12.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.559+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:20:12.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.569+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:20:12.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:20:12.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.639+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:20:12.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.642+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:12.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.677+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:12.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.681+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:12.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.698+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:20:12.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.718+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:20:12.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:12.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.738+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:20:12.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.747+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:20:12.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.753+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:20:12.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.777+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:20:12.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:20:12.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:20:12.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.822+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:20:12.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.858+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:20:12.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.861+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:12.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.923+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:20:12.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:12.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.990+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:20:12.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:12.991+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:20:13.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.059+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:20:13.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.068+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:13.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.083+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:20:13.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.103+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:20:13.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.104+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:20:13.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.138+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:13.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.150+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:20:13.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.179+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:13.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.193+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:20:13.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:20:13.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.210+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:20:13.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.224+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:13.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.239+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:13.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.255+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:20:13.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.272+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:20:13.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.278+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:20:13.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.303+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:13.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.307+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:13.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:20:13.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.333+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:20:13.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.362+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:20:13.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.367+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:13.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.397+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:13.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.399+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:20:13.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.416+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:13.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.438+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:13.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:20:13.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.472+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:13.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:20:13.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.498+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:20:13.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 37 16 535630 535614 904.658 919.25 0.000613918 0.0010909 2024-04-20T02:20:13.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.536+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:20:13.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.549+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:20:13.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.561+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:20:13.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.563+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:20:13.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.591+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:13.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.610+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:13.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.638+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:13.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.665+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:20:13.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.666+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:20:13.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.700+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:20:13.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.705+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:20:13.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.711+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:20:13.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.737+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:13.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.746+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:20:13.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.765+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:20:13.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:20:13.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:20:13.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.795+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:13.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.825+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:20:13.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.826+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:20:13.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.863+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:20:13.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.879+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:13.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:13.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.935+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:20:13.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.936+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:20:13.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.970+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:13.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:13.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:13.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:13.998+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:20:14.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.013+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:20:14.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.039+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:14.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:14.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.061+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:14.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.076+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:14.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.086+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:20:14.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.119+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:20:14.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.124+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:20:14.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.190+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:20:14.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.204+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:14.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.205+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:20:14.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.267+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:14.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.291+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:14.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.314+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:20:14.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.325+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:20:14.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.331+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:14.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.339+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:14.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:20:14.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.363+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:14.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.385+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:20:14.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.415+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:20:14.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.424+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:14.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.454+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:20:14.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.456+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:14.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:14.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 38 16 550351 550335 905.057 920.062 0.000655794 0.00109043 2024-04-20T02:20:14.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.542+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:20:14.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.547+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:20:14.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.560+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:20:14.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.566+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:14.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.584+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:20:14.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.616+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:20:14.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.632+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:20:14.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.638+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:14.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.654+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:20:14.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.659+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:20:14.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.690+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:20:14.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.697+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:20:14.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.703+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:20:14.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.711+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:14.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.730+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:14.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:14.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.759+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:20:14.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:20:14.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.777+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:20:14.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:20:14.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.814+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:20:14.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.823+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:20:14.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.841+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:20:14.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.873+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:20:14.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.927+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:20:14.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.931+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:20:14.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.947+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:14.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.965+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:20:14.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:14.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:14.993+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:20:15.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.006+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:20:15.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.010+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:15.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.024+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:20:15.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.031+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:20:15.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.037+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:15.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.056+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:20:15.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:20:15.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.093+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:20:15.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.117+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:20:15.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.148+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:20:15.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.166+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:20:15.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.198+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:15.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.235+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:15.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.238+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:20:15.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.264+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:20:15.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.282+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:15.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:15.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.298+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:20:15.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.323+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:20:15.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.325+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:15.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.343+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:15.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:20:15.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.368+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:15.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.388+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:20:15.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.404+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:20:15.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.424+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:15.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.424+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:15.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.435+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:20:15.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.451+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:15.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.469+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:20:15.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.503+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:20:15.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.519+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:20:15.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.521+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:20:15.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 39 16 564851 564835 905.085 906.25 0.00263512 0.00109039 2024-04-20T02:20:15.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:20:15.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.544+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:20:15.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.559+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:15.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:20:15.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.584+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:15.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.602+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:15.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.604+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:20:15.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.616+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:15.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.623+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:20:15.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.638+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:20:15.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.644+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:20:15.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.687+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:20:15.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.705+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:20:15.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.731+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:15.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.739+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:15.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.765+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:15.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.785+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:20:15.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.800+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:15.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.805+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:15.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.868+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:20:15.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.881+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:20:15.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:20:15.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.908+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:15.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.919+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:15.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.926+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:20:15.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.953+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:20:15.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.977+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:15.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.989+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:20:15.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:15.994+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:20:16.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.002+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:20:16.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.013+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:16.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.028+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:20:16.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.046+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:20:16.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.079+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:20:16.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.081+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:20:16.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:20:16.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.113+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:20:16.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.133+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:20:16.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.140+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:16.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.153+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:20:16.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.188+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:20:16.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.203+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:20:16.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.209+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:20:16.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.249+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:16.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.259+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:20:16.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.260+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:16.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.282+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:20:16.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.338+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:16.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.361+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:20:16.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.381+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:16.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:20:16.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.447+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:20:16.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.469+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:20:16.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.491+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:20:16.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.494+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:20:16.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:20:16.524202+0000 min lat: 0.000240007 max lat: 0.0996019 avg lat: 0.00109049 2024-04-20T02:20:16.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:20:16.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 40 16 579298 579282 905.029 902.938 0.000675395 0.00109049 2024-04-20T02:20:16.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.531+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:20:16.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.546+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:20:16.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.550+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:20:16.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.573+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:20:16.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:20:16.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.606+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:20:16.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.610+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:20:16.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:20:16.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.644+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:16.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.653+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:20:16.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.686+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:20:16.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.693+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:20:16.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.697+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:16.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.731+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:20:16.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.737+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:16.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.760+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:20:16.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:20:16.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.775+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:20:16.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.782+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:20:16.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.803+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:20:16.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.822+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:16.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.855+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:20:16.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.864+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:16.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.872+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:20:16.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.881+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:20:16.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.896+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:20:16.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.900+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:20:16.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.932+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:20:16.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.956+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:20:16.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:16.988+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:20:17.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.006+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:17.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.015+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:20:17.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.022+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:20:17.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.035+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:17.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:17.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.063+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:20:17.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.065+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:17.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.090+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:20:17.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.135+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:20:17.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:20:17.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.158+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:17.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.160+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:20:17.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.169+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:20:17.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.183+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:17.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.205+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:17.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.207+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:17.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.208+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:20:17.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.251+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:20:17.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.257+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:17.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.301+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:17.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.303+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:20:17.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.333+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:20:17.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.344+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:20:17.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.358+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:20:17.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.372+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:17.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.384+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:20:17.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.397+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:17.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.413+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:17.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.415+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:17.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.425+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:20:17.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.453+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:20:17.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.470+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:17.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.489+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:20:17.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:20:17.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.511+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:17.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 41 16 593816 593800 905.083 907.375 0.000787888 0.00109042 2024-04-20T02:20:17.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.543+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:20:17.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.546+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:20:17.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.551+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:20:17.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.576+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:20:17.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.600+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:20:17.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:20:17.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:20:17.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.637+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:20:17.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.664+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:17.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.673+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:20:17.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.674+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:17.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.723+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:20:17.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.730+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:20:17.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:17.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.741+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:17.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.763+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:17.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.780+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:20:17.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.789+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:20:17.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.789+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:20:17.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.808+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:20:17.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.823+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:20:17.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.829+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:20:17.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.848+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:20:17.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.863+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:20:17.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.877+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:20:17.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.898+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:20:17.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.904+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:17.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.910+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:20:17.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.916+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:20:17.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.940+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:17.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.954+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:17.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.974+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:20:17.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.992+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:20:17.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:20:17.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:17.997+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:20:18.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.004+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:20:18.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.046+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:20:18.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.050+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:20:18.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.061+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:20:18.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.068+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:20:18.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.068+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:20:18.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:18.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.084+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:20:18.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:18.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.132+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:20:18.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.136+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:20:18.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.154+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:18.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.190+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:20:18.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.192+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:20:18.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.221+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:20:18.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.224+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:20:18.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.243+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:20:18.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.258+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:18.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.280+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:18.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:20:18.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.313+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:18.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:20:18.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.343+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:20:18.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.370+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:18.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.382+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:20:18.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.408+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:18.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.429+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:20:18.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.435+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:20:18.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.468+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:20:18.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.493+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:20:18.522 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 42 16 608266 608250 905.034 903.125 0.00205318 0.00109048 2024-04-20T02:20:18.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.566+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:20:18.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.571+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:20:18.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.599+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:20:18.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.622+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:18.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.642+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:18.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.644+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:20:18.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.680+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:18.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.687+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:20:18.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.699+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:18.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.704+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:20:18.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.722+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:20:18.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.741+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:20:18.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.761+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:18.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.768+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:20:18.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.777+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:20:18.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.786+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:20:18.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.817+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:18.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.824+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:20:18.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.831+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:18.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.834+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:18.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.840+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:20:18.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.862+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:18.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.882+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:20:18.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.891+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:20:18.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.905+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:20:18.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.908+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:20:18.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.911+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:20:18.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.937+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:20:18.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.948+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:20:18.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:20:18.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:18.966+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:20:19.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.010+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:20:19.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.013+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:20:19.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.042+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:20:19.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.050+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:20:19.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.056+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:19.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.062+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:20:19.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:20:19.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.104+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:20:19.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.121+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:20:19.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.158+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:20:19.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.178+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:20:19.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.191+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:20:19.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.206+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:20:19.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.248+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:20:19.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:20:19.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.302+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:20:19.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.311+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:19.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.330+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:19.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.345+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:20:19.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.368+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:20:19.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.396+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:20:19.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.424+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:20:19.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:20:19.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.436+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:19.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:20:19.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:19.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.499+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:19.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.506+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:19.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.510+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:20:19.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.516+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:19.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 43 16 623016 623000 905.424 921.875 0.000843452 0.00108995 2024-04-20T02:20:19.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.546+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:20:19.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.546+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:20:19.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.587+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:20:19.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.591+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:20:19.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.613+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:20:19.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.628+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:19.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.637+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:20:19.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.657+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:19.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:20:19.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.680+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:19.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.708+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:20:19.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:20:19.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:20:19.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.749+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:20:19.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.751+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:19.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:20:19.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:20:19.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.802+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:20:19.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.825+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:19.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.845+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:20:19.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:19.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.902+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:20:19.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.907+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:20:19.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.913+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:20:19.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.947+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:20:19.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.957+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:20:19.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.994+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:19.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:19.996+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:20:20.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.011+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:20:20.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.014+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:20:20.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.058+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:20.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.070+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:20:20.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.073+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:20.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.085+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:20.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.101+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:20:20.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.108+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:20:20.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.121+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:20:20.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.155+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:20:20.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.155+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:20:20.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.203+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:20:20.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.223+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:20.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.225+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:20.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.233+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:20:20.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.314+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:20.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.341+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:20:20.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.350+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:20:20.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.355+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:20:20.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.359+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:20:20.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.383+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:20:20.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:20.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:20:20.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.423+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:20:20.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.431+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:20:20.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:20.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.453+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:20:20.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.459+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:20.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.475+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:20.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.478+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:20:20.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.512+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:20:20.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:20:20.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 44 16 636865 636849 904.515 865.562 0.00102728 0.00109106 2024-04-20T02:20:20.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:20:20.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.551+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:20.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.571+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:20:20.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.587+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:20:20.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.600+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:20:20.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:20.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.616+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:20:20.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.620+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:20.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.658+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:20.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.672+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:20:20.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.696+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:20.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.711+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:20:20.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.764+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:20:20.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.769+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:20.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.791+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:20:20.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:20:20.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.810+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:20:20.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.811+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:20:20.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.844+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:20.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.850+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:20.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.877+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:20:20.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.901+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:20:20.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.919+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:20:20.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.920+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:20:20.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:20.953+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:20:21.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.009+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:20:21.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.026+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:20:21.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:20:21.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.053+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:20:21.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.062+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:20:21.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.076+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:21.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.142+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:20:21.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:20:21.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.176+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:21.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.176+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:21.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.186+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:20:21.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.209+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:21.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.228+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:20:21.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:20:21.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.297+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:20:21.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.300+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:20:21.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.320+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:21.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:20:21.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.347+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:20:21.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.381+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:20:21.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.404+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:20:21.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:20:21.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.436+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:21.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.472+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:20:21.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.492+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:21.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:20:21.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 45 16 650340 650324 903.128 842.188 0.000944124 0.00109279 2024-04-20T02:20:21.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.548+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:20:21.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.557+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:21.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.581+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:21.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.583+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:20:21.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.597+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:20:21.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.604+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:20:21.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.628+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:20:21.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.641+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:21.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.672+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:20:21.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:21.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.698+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:20:21.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.715+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:20:21.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.773+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:20:21.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.801+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:20:21.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.806+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:20:21.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.826+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:20:21.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.837+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:20:21.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.848+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:20:21.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.877+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:20:21.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.890+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:20:21.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.912+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:21.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:20:21.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:21.991+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:22.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.011+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:20:22.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.015+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:20:22.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.017+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:20:22.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.063+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:20:22.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.069+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:20:22.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.085+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:20:22.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.108+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:20:22.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.108+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:20:22.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.110+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:22.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.129+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:22.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.131+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:20:22.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.161+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:20:22.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.181+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:20:22.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.191+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:20:22.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.221+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:20:22.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.224+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:20:22.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.229+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:20:22.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.247+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:20:22.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.265+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:20:22.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.267+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:20:22.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.283+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:22.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.295+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:22.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.303+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:20:22.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.338+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:20:22.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:20:22.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.389+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:20:22.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.408+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:20:22.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:20:22.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.437+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:20:22.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.472+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:22.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.478+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:20:22.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:22.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 46 15 665169 665154 903.643 926.875 0.00121995 0.00109216 2024-04-20T02:20:22.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.576+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:20:22.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.582+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:20:22.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.598+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:20:22.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.603+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:20:22.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.629+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:20:22.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:20:22.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.651+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:20:22.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.659+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:20:22.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.676+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:20:22.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.687+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:20:22.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.720+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:20:22.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:20:22.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.748+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:20:22.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.756+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:20:22.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.776+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:20:22.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.780+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:20:22.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.816+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:20:22.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.825+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:22.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.831+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:20:22.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.855+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:22.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:20:22.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.900+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:20:22.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.922+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:20:22.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:22.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.932+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:20:22.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:22.969+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:23.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.028+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:20:23.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.038+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:20:23.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.081+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:20:23.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.095+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:20:23.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:20:23.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.108+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:23.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.119+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:20:23.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.132+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:20:23.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.176+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:20:23.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.181+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:20:23.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.201+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:20:23.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.244+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:20:23.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.244+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:23.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.258+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:20:23.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.272+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:20:23.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.282+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:20:23.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.305+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:20:23.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.332+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:20:23.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.356+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:23.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.367+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:20:23.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.380+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:23.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.392+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:20:23.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:23.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.419+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:20:23.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.436+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:23.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.458+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:23.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.474+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:23.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.480+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:20:23.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.494+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:20:23.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.504+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:20:23.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.519+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:23.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 47 16 679876 679860 903.971 919.125 0.00120638 0.00109175 2024-04-20T02:20:23.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:20:23.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.555+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:20:23.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.556+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:20:23.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.594+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:20:23.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.616+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:20:23.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.621+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:20:23.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:20:23.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.644+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:20:23.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:20:23.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:20:23.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.732+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:20:23.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.735+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:20:23.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.736+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:20:23.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.764+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:23.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.771+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:20:23.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:20:23.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.796+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:20:23.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.798+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:20:23.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.811+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:23.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.828+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:23.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:23.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:20:23.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.855+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:23.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.864+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:20:23.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.886+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:20:23.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.893+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:20:23.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.940+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:23.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:20:23.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:23.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:23.988+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:24.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.020+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:20:24.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.031+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:24.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.058+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:24.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.070+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:20:24.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.072+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:20:24.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.134+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:20:24.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.137+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:20:24.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.171+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:20:24.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.194+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:24.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.205+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:20:24.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.232+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:20:24.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.232+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:20:24.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.255+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:20:24.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.267+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:20:24.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.277+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:24.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.297+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:20:24.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.327+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:24.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.329+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:20:24.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.347+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:24.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.368+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:24.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.395+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:24.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.397+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:20:24.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.418+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:20:24.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.449+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:20:24.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.489+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:24.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.518+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:20:24.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:20:24.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 48 16 694518 694502 904.202 915.125 0.000889583 0.00109144 2024-04-20T02:20:24.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.551+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:24.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.552+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:20:24.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.595+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:24.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.598+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:20:24.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.611+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:20:24.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.646+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:20:24.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.653+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:20:24.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.679+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:20:24.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.680+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:20:24.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:20:24.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.726+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:20:24.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.741+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:20:24.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.743+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:20:24.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.757+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:20:24.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.774+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:24.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.778+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:20:24.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.808+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:20:24.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.810+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:20:24.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.859+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:24.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.859+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:20:24.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.894+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:20:24.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.905+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:24.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.923+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:20:24.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.937+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:20:24.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.958+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:24.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:24.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:20:25.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.005+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:25.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.018+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:20:25.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.035+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:25.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.040+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:25.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.050+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:25.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.063+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:20:25.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.071+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:20:25.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.092+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:25.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.114+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:20:25.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:25.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:20:25.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.181+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:20:25.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.187+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:25.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.206+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:20:25.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.215+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:20:25.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.231+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:25.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.233+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:25.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.247+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:25.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.282+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:25.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.359+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:20:25.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.364+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:20:25.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.393+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:20:25.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.399+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:25.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:25.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.445+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:25.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.470+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:20:25.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 49 15 708078 708063 903.044 847.562 0.000552092 0.00109286 2024-04-20T02:20:25.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.529+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:20:25.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.536+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:20:25.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.576+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:20:25.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.587+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:20:25.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.602+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:20:25.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.603+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:20:25.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.625+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:20:25.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.631+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:25.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.655+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:20:25.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:20:25.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.663+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:20:25.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.669+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:20:25.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:20:25.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.707+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:20:25.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.712+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:20:25.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.728+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:25.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.740+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:20:25.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.748+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:20:25.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.764+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:20:25.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.780+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:20:25.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.781+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:25.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:20:25.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.810+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:20:25.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.825+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:20:25.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.871+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:20:25.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.882+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:20:25.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:20:25.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.919+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:20:25.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.953+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:20:25.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:25.998+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:20:26.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.006+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:20:26.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.024+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:20:26.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.034+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:20:26.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.051+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:20:26.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:20:26.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.084+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:20:26.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:20:26.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.117+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:20:26.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.203+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:20:26.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.223+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:20:26.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.242+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:20:26.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.245+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:20:26.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.246+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:26.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.273+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:26.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.295+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:20:26.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.296+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:20:26.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.318+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:26.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.319+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:20:26.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.320+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:26.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.350+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:20:26.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.395+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:20:26.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.405+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:20:26.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.424+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:20:26.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.442+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:20:26.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.443+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:26.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.449+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:20:26.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.489+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:20:26.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.523+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:20:26.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 50 16 721381 721365 901.61 831.375 0.00208765 0.00109463 2024-04-20T02:20:26.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.540+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:20:26.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.602+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:20:26.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.620+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:26.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.628+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:20:26.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.630+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:20:26.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:20:26.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.663+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:20:26.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:20:26.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.728+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:20:26.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.746+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:26.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.765+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:26.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.768+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:20:26.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.797+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:20:26.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.824+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:20:26.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.847+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:20:26.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.886+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:20:26.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.914+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:26.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.926+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:26.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.942+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:26.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.956+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:20:26.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:26.973+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:20:27.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.007+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:20:27.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.046+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:20:27.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.048+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:27.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:20:27.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.093+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:20:27.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.099+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:20:27.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.104+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:27.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.134+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:20:27.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.137+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:20:27.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.169+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:20:27.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.171+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:20:27.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.189+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:20:27.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.210+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:20:27.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.240+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:27.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.259+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:27.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.261+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:20:27.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.293+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:20:27.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.310+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:27.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.323+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:20:27.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:27.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.363+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:20:27.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.381+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:20:27.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.381+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:20:27.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.396+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:20:27.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.421+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:27.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.424+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:20:27.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.459+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:20:27.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.475+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:27.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.475+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:20:27.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.494+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:20:27.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.503+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:27.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.513+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:20:27.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 51 16 736125 736109 901.999 921.5 0.000757274 0.00109414 2024-04-20T02:20:27.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.549+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:20:27.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.565+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:20:27.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.586+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:20:27.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.597+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:20:27.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.610+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:20:27.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.622+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:20:27.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.630+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:20:27.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.646+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:20:27.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.653+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:20:27.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.658+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:20:27.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:20:27.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.691+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:27.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.707+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:20:27.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.723+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:27.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:20:27.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:20:27.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:20:27.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.757+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:27.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.763+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:27.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:20:27.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.787+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:20:27.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.800+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:20:27.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.810+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:27.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:27.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:20:27.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.931+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:27.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.945+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:20:27.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.946+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:27.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.956+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:20:27.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:27.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:27.982+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:20:28.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.004+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:20:28.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.009+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:20:28.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.045+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:20:28.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.062+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:20:28.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.085+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:28.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.126+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:20:28.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.135+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:20:28.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.162+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:20:28.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.179+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:20:28.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.197+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:20:28.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.217+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:20:28.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.229+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:20:28.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.243+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:20:28.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.257+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:20:28.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.307+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:20:28.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.309+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:20:28.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.329+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:20:28.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.333+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:20:28.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.365+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:20:28.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.372+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:20:28.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:28.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.401+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:20:28.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:28.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.421+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:20:28.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.428+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:28.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.447+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:20:28.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.455+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:20:28.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.477+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:20:28.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.481+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:20:28.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.487+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:20:28.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.504+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:28.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.511+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:28.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 52 16 750672 750656 902.135 909.188 0.000596689 0.00109398 2024-04-20T02:20:28.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.536+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:28.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.558+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:20:28.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.574+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:20:28.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.577+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:20:28.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.600+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:20:28.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.608+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:20:28.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.615+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:20:28.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.638+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:20:28.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.660+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:20:28.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.692+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:28.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.707+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:28.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.709+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:20:28.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.733+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:20:28.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.754+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:28.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:20:28.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.792+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:20:28.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.814+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:20:28.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.818+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:20:28.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.826+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:20:28.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:20:28.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.859+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:28.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.896+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:20:28.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:28.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:28.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.914+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:20:28.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:28.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.949+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:20:28.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.953+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:20:28.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:28.978+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:29.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.012+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:20:29.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:29.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.014+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:20:29.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:29.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.079+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:29.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.091+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:20:29.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.099+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:29.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.119+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:20:29.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.151+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:20:29.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.167+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:29.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.177+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:20:29.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.178+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:29.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.211+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:20:29.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.221+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:29.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.283+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:20:29.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.303+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:20:29.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.312+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:20:29.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.316+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:20:29.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.345+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:20:29.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.354+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:29.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.374+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:20:29.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.387+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:29.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:20:29.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.433+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:20:29.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:29.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.450+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:29.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.466+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:20:29.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:20:29.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:20:29.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.522+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:29.523 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 53 16 765326 765310 902.393 915.875 0.000915655 0.00109368 2024-04-20T02:20:29.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.526+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:20:29.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.558+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:20:29.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:20:29.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.584+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:20:29.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.605+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:20:29.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.609+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:20:29.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.631+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:29.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.653+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:29.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.672+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:29.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.676+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:29.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.705+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:20:29.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.727+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:20:29.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.746+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:20:29.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.756+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:20:29.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.757+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:20:29.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.773+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:20:29.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.794+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:20:29.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.806+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:20:29.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.852+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:29.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.853+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:20:29.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.873+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:20:29.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.885+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:20:29.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.887+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:29.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.930+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:20:29.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.935+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:29.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.946+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:20:29.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.973+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:20:29.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:29.973+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:20:30.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:30.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.023+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:30.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:30.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:30.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.067+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:30.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.079+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:30.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.118+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:30.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.158+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:20:30.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.170+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:20:30.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.178+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:30.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.196+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:30.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.201+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:20:30.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.208+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:20:30.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.238+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:30.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.242+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:20:30.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.259+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:20:30.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.264+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:20:30.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.292+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:20:30.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.304+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:20:30.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:30.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.351+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:20:30.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.366+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:20:30.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.385+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:20:30.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.399+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:20:30.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.409+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:30.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:20:30.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.437+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:30.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.447+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:20:30.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.469+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:20:30.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.474+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:20:30.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.504+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:20:30.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 54 16 780098 780082 902.778 923.25 0.000782131 0.00109321 2024-04-20T02:20:30.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.536+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:20:30.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.541+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:20:30.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.551+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:20:30.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.603+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:20:30.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.628+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:20:30.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:20:30.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.644+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:20:30.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.708+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:20:30.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.716+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:20:30.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.797+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:30.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.824+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:30.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.835+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:20:30.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.863+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:20:30.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.891+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:20:30.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.924+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:30.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.946+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:20:30.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:30.957+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:31.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.030+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:31.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.043+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:31.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.057+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:20:31.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.067+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:20:31.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.098+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:20:31.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.108+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:20:31.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.120+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:31.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.195+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:20:31.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.241+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:20:31.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:20:31.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.289+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:20:31.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.294+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:20:31.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.319+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:20:31.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.320+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:20:31.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.337+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:20:31.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.355+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:31.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.376+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:20:31.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.399+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:20:31.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:31.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.424+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:20:31.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.448+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:20:31.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.483+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:31.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.489+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:20:31.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.516+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:20:31.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 55 16 794681 794665 902.933 911.438 0.00112756 0.00109299 2024-04-20T02:20:31.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.534+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:20:31.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.547+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:20:31.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.560+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:20:31.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:20:31.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.603+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:20:31.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.619+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:20:31.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.631+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:20:31.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.652+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:20:31.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.659+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:20:31.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.686+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:31.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.700+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:20:31.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.721+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:20:31.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.738+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:20:31.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.745+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:31.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:20:31.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.807+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:20:31.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.808+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:31.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.839+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:20:31.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.841+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:20:31.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.880+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:20:31.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.889+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:31.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.909+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:20:31.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.915+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:20:31.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.927+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:20:31.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.939+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:31.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.959+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:20:31.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.962+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:20:31.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:31.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:20:32.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.013+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:32.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.030+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:20:32.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.036+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:32.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.061+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:20:32.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.071+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:20:32.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.108+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:32.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.151+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:20:32.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.156+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:32.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.162+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:20:32.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.195+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:20:32.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.198+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:20:32.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.222+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:20:32.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.233+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:32.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.250+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:20:32.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:20:32.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.282+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:20:32.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.292+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:20:32.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.292+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:20:32.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.332+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:20:32.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.361+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:32.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:20:32.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.381+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:20:32.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.403+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:20:32.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.407+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:32.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.425+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:20:32.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.428+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:20:32.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.448+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:32.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:20:32.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:20:32.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.510+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:32.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 56 16 809180 809164 902.99 906.188 0.000628101 0.00109291 2024-04-20T02:20:32.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.567+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:20:32.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.584+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:32.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.593+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:20:32.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.595+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:32.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.598+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:20:32.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:20:32.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.670+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:20:32.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.709+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:20:32.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.728+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:32.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.737+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:32.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:32.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.760+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:20:32.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.781+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:20:32.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.790+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:20:32.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.805+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:20:32.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.846+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:20:32.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.862+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:32.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.892+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:20:32.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.907+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:20:32.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.912+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:20:32.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:20:32.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.938+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:32.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.950+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:20:32.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:32.953+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:33.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.005+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:20:33.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:20:33.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.034+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:20:33.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.038+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:20:33.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.046+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:20:33.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.077+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:33.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.082+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:20:33.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.113+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:20:33.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.126+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:20:33.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.147+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:20:33.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.166+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:33.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.167+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:33.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.241+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:20:33.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.258+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:20:33.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.263+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:20:33.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.281+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:33.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.295+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:33.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.308+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:20:33.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.320+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:20:33.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.322+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:33.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.334+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:33.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.360+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:20:33.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.374+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:20:33.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:20:33.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.396+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:20:33.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.407+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:20:33.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.427+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:20:33.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.428+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:20:33.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.464+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:33.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.464+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:20:33.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.481+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:33.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.502+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:33.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.516+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:20:33.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 57 16 822929 822913 902.223 859.312 0.00109466 0.00109387 2024-04-20T02:20:33.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.535+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:20:33.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.570+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:33.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.571+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:20:33.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.591+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:20:33.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:33.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.616+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:20:33.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.636+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:20:33.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.651+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:20:33.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.653+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:20:33.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.672+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:20:33.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.686+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:20:33.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.697+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:33.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.715+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:20:33.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.716+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:33.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.727+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:20:33.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.780+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:20:33.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:33.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.811+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:20:33.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.816+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:33.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:20:33.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.887+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:20:33.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:20:33.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.959+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:20:33.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.967+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:33.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.970+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:20:33.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.996+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:20:33.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:33.996+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:20:34.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.007+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:20:34.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.054+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:20:34.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.090+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:34.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:20:34.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.148+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:20:34.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.177+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:20:34.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.182+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:20:34.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.210+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:34.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.221+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:34.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.228+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:20:34.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.234+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:20:34.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.259+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:34.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.283+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:20:34.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.283+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:20:34.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.294+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:20:34.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.314+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:34.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.314+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:34.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.329+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:20:34.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.344+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:20:34.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.381+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:20:34.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.396+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:34.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.429+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:20:34.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.432+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:20:34.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.463+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:20:34.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.490+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:20:34.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.493+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:20:34.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.502+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:34.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.521+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:20:34.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 58 16 836563 836547 901.358 852.125 0.00236376 0.00109494 2024-04-20T02:20:34.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.539+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:20:34.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.544+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:20:34.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.559+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:20:34.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.591+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:20:34.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.600+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:20:34.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.608+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:20:34.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.650+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:20:34.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.659+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:20:34.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.708+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:20:34.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.711+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:34.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.756+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:34.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.778+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:20:34.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.797+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:20:34.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.814+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:20:34.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.819+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:20:34.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.877+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:20:34.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.908+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:20:34.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.935+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:20:34.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.958+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:34.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.964+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:34.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.966+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:20:34.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:20:34.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:34.993+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:20:35.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.007+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:35.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.014+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:20:35.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.018+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:20:35.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.022+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:20:35.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.052+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:35.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.072+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:20:35.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.087+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:35.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.094+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:35.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.099+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:20:35.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.116+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:35.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.136+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:20:35.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.139+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:20:35.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:20:35.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.185+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:20:35.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.227+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:20:35.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.245+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:35.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.268+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:20:35.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.268+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:20:35.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.291+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:20:35.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.318+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:35.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.333+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:20:35.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.378+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:35.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:20:35.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.418+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:20:35.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:20:35.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.457+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:20:35.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.459+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:35.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.496+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:20:35.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.504+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:35.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.513+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:20:35.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 59 16 850203 850187 900.528 852.5 0.00242093 0.00109592 2024-04-20T02:20:35.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.533+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:20:35.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:35.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.562+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:20:35.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.586+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:20:35.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:20:35.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.621+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:35.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.631+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:20:35.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.669+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:20:35.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.669+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:20:35.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.682+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:35.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:35.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:20:35.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:20:35.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.755+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:20:35.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.765+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:20:35.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.774+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:20:35.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.776+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:35.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.780+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:20:35.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.798+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:20:35.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.807+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:20:35.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.809+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:35.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.841+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:20:35.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.845+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:20:35.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.854+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:20:35.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.891+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:35.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:20:35.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.922+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:20:35.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.955+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:20:35.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.956+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:20:35.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.958+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:20:35.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.986+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:20:35.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.990+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:20:35.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:35.997+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:20:36.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.007+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:20:36.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.035+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:20:36.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.045+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:20:36.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.047+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:20:36.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.066+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:36.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:36.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.110+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:36.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.111+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:20:36.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.126+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:36.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.146+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:20:36.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.149+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:20:36.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:36.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.178+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:20:36.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.199+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:20:36.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.238+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:20:36.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.260+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:20:36.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:20:36.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.292+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:36.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:36.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.310+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:20:36.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.316+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:20:36.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.358+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:20:36.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:36.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.387+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:36.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:20:36.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.414+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:36.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.418+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:20:36.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:20:36.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.461+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:36.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.472+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:20:36.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.486+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:20:36.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:20:36.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.519+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:20:36.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:20:36.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.520+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:36.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:20:36.526019+0000 min lat: 0.000240007 max lat: 0.0996019 avg lat: 0.00109583 2024-04-20T02:20:36.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:20:36.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 60 16 864693 864677 900.612 905.625 0.00066084 0.00109583 2024-04-20T02:20:36.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.537+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:36.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.554+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:20:36.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.567+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:20:36.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:36.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.583+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:20:36.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.606+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:20:36.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.623+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:20:36.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.633+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:20:36.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.653+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:20:36.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.665+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:20:36.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.669+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:20:36.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:20:36.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.684+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:36.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:20:36.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.724+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:20:36.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.730+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:36.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:36.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.760+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:20:36.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.777+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:20:36.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.793+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:36.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.816+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:20:36.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.825+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:20:36.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.825+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:36.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.836+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:36.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.859+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:20:36.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:36.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.890+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:20:36.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.955+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:20:36.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.975+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:20:36.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:36.975+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:37.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.002+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:20:37.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.016+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:20:37.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.017+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:20:37.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.039+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:20:37.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.041+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:20:37.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.056+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:20:37.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.078+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:20:37.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.085+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:20:37.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.127+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:20:37.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:37.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.176+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:20:37.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.216+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:20:37.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.226+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:20:37.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.234+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:20:37.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.242+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:37.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:37.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.312+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:20:37.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.344+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:20:37.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.354+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:20:37.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.366+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:20:37.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:20:37.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:20:37.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.393+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:20:37.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.422+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:20:37.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.463+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:20:37.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.470+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:20:37.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.480+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:37.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.494+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:20:37.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.505+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:20:37.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 61 16 879409 879393 900.923 919.75 0.000951771 0.00109547 2024-04-20T02:20:37.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.573+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:20:37.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.591+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:20:37.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:20:37.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.625+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:20:37.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.627+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:37.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.645+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:20:37.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.658+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:20:37.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.662+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:20:37.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.673+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:37.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.698+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:20:37.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.718+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:20:37.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.749+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:20:37.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.783+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:20:37.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.784+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:37.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.821+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:37.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:20:37.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.840+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:20:37.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.852+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:20:37.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.855+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:20:37.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.893+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:20:37.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.908+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:20:37.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.929+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:20:37.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.940+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:20:37.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.947+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:20:37.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.955+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:20:37.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:37.989+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:38.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.016+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:20:38.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.029+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:20:38.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.047+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:38.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.053+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:20:38.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.061+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:20:38.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.079+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:20:38.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.099+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:38.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.184+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:38.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.192+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:20:38.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.208+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:20:38.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.222+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:20:38.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.267+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:20:38.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:20:38.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.309+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:20:38.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:20:38.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.342+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:38.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.360+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:20:38.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.365+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:38.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.404+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:20:38.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.405+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:20:38.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.408+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:20:38.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.424+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:20:38.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.444+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:20:38.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:20:38.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.477+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:20:38.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.483+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:20:38.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.499+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:38.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.515+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:38.524 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 62 16 894273 894257 901.375 929 0.00128438 0.0010949 2024-04-20T02:20:38.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.564+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:20:38.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.575+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:20:38.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:20:38.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.612+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:20:38.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.629+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:38.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.635+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:20:38.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.644+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:38.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.659+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:20:38.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.669+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:20:38.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.675+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:20:38.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.697+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:20:38.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.728+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:20:38.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.732+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:20:38.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.740+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:20:38.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.758+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:38.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.776+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:38.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.783+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:20:38.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.826+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:38.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.841+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:20:38.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.857+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:20:38.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.861+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:38.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.877+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:20:38.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.953+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:20:38.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.966+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:38.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:38.971+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:20:39.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.016+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:20:39.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.021+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:20:39.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:20:39.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.078+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:20:39.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.088+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:20:39.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.098+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:20:39.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.119+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:20:39.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.137+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:39.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.139+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:20:39.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.159+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:20:39.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.185+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:20:39.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:39.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.227+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:39.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.243+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:20:39.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.256+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:20:39.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.269+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:20:39.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.271+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:20:39.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.288+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:20:39.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.296+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:20:39.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.312+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:39.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.333+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:39.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:20:39.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.365+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:39.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:20:39.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.379+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:20:39.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:20:39.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.396+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:39.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.409+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:20:39.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.442+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:39.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.447+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:20:39.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.454+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:20:39.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.459+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:20:39.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.475+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:39.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.484+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:20:39.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.503+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:39.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.512+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:39.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 63 16 908774 908758 901.449 906.312 0.00126678 0.00109478 2024-04-20T02:20:39.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.546+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:20:39.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.550+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:39.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.577+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:20:39.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.591+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:20:39.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.596+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:20:39.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:20:39.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.633+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:20:39.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.647+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:39.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.665+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:20:39.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.673+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:20:39.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:20:39.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.694+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:39.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.698+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:20:39.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.705+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:20:39.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.706+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:39.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.747+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:39.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.751+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:39.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.766+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:20:39.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:20:39.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.807+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:20:39.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.819+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:39.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.841+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:20:39.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.863+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:20:39.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.874+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:20:39.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.911+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:20:39.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.914+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:20:39.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.946+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:20:39.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:39.947+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:20:40.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.012+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:20:40.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.056+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:20:40.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.057+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:20:40.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.071+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:20:40.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.086+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:40.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.107+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:40.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.123+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:20:40.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.139+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:20:40.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.152+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:20:40.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.162+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:20:40.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.179+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:40.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:20:40.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.214+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:20:40.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.223+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:40.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.257+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:40.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.262+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:20:40.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.312+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:40.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.329+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:20:40.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.338+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:20:40.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.411+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:20:40.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:20:40.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.454+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:20:40.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.463+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:20:40.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.478+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:20:40.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 64 16 923225 923209 901.474 903.188 0.00103682 0.00109479 2024-04-20T02:20:40.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.533+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:20:40.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:20:40.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.581+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:20:40.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.595+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:20:40.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.599+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:20:40.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.613+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:20:40.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.628+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:20:40.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.655+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:20:40.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.664+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:20:40.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.721+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:20:40.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.755+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:40.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.759+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:40.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:20:40.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.795+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:20:40.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.839+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:40.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:20:40.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.879+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:20:40.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.894+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:20:40.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.933+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:20:40.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.972+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:20:40.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:40.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:20:41.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.022+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:20:41.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.026+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:20:41.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:20:41.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.079+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:41.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.088+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:20:41.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.111+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:20:41.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.126+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:20:41.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.140+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:20:41.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:20:41.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.238+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:20:41.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.290+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:20:41.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.308+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:20:41.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.341+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:20:41.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.361+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:20:41.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.373+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:20:41.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.384+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:20:41.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.393+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:20:41.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.394+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:20:41.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.426+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:41.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.441+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:20:41.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:20:41.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.461+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:20:41.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.510+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:41.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.521+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:20:41.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 65 15 937661 937646 901.485 902.312 0.000967682 0.00109475 2024-04-20T02:20:41.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.533+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:20:41.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.547+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:41.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.561+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:20:41.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.568+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:20:41.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.649+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:20:41.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:41.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.676+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:41.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.693+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:20:41.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.706+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:20:41.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.720+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:20:41.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:41.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.768+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:20:41.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.775+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:41.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.779+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:20:41.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.802+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:20:41.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:20:41.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.811+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:41.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.828+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:41.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.831+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:41.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.844+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:20:41.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.857+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:20:41.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.862+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:20:41.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.877+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:20:41.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.892+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:41.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.915+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:20:41.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.934+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:41.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:20:41.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.988+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:20:41.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:41.997+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:20:42.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.009+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:20:42.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.031+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:20:42.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.074+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:42.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.137+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:20:42.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.149+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:20:42.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.152+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:20:42.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.165+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:20:42.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.211+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:20:42.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.212+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:20:42.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.230+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:42.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.280+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:42.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.284+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:20:42.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.301+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:20:42.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.309+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:20:42.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.317+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:20:42.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:42.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.349+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:20:42.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:20:42.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.386+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:20:42.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:20:42.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.415+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:42.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:42.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:20:42.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.439+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:20:42.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.450+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:20:42.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.451+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:20:42.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.470+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:20:42.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.487+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:42.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.499+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:20:42.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.508+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:20:42.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.521+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:20:42.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 66 15 951106 951091 900.556 840.312 0.00134842 0.00109591 2024-04-20T02:20:42.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.532+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:20:42.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:20:42.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.550+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:42.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.558+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:20:42.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.561+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:20:42.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:20:42.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.595+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:20:42.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.608+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:20:42.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.627+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:20:42.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.634+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:20:42.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.639+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:42.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.669+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:20:42.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.689+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:20:42.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:20:42.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.718+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:20:42.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.723+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:20:42.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.753+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:20:42.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.756+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:20:42.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.774+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:20:42.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:20:42.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:20:42.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:20:42.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.824+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:20:42.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.829+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:20:42.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.842+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:42.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.862+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:20:42.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.879+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:20:42.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.883+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:20:42.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.896+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:20:42.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.897+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:20:42.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.935+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:20:42.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:20:42.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.955+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:42.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.970+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:20:42.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.971+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:20:42.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:42.985+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:20:43.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.030+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:20:43.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.038+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:43.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.042+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:43.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.047+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:20:43.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.108+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:20:43.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.110+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:20:43.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.118+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:20:43.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.122+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:20:43.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.153+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:20:43.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.162+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:43.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.184+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:20:43.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.204+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:20:43.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.207+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:20:43.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.223+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:20:43.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.246+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:20:43.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.267+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:20:43.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.296+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:20:43.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:20:43.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.322+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:20:43.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.339+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:20:43.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.340+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:20:43.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.359+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:20:43.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.364+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:20:43.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.367+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:20:43.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:43.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:43.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.435+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:20:43.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.438+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:43.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.464+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:43.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.486+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:20:43.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.500+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:20:43.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 67 16 965406 965390 900.452 893.688 0.00137555 0.00109604 2024-04-20T02:20:43.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.527+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:43.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.549+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:43.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.551+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:20:43.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.569+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:43.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.588+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:43.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.591+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:43.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.599+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:43.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.630+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:20:43.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:20:43.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.664+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:20:43.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.666+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:20:43.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.696+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:20:43.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.699+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:20:43.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.753+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:43.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:20:43.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.800+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:43.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.818+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:20:43.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.847+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:43.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.854+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:20:43.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.877+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:20:43.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.886+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:43.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.888+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:20:43.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.889+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:20:43.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.912+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:43.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.929+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:20:43.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.945+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:20:43.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.955+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:20:43.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.969+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:20:43.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.976+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:20:43.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:43.979+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:20:44.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.022+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:20:44.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.025+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:20:44.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:20:44.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.068+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:44.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.082+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:20:44.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.093+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:20:44.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.115+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:20:44.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.125+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:20:44.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.128+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:44.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.141+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:20:44.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.168+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:20:44.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.170+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:20:44.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.182+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:20:44.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.207+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:20:44.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.219+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:20:44.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.261+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:20:44.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.272+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:20:44.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.283+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:44.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.283+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:20:44.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.338+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:44.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.338+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:20:44.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.357+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:20:44.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.381+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:20:44.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.384+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:20:44.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.399+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:20:44.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.411+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:20:44.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.460+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:20:44.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.474+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:20:44.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.493+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:20:44.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.509+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:20:44.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 68 16 980015 979999 900.636 913.062 0.00187485 0.00109581 2024-04-20T02:20:44.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.529+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:20:44.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.556+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:20:44.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.598+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:20:44.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:20:44.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.629+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:20:44.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.645+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:20:44.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.661+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:20:44.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.674+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:20:44.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.689+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:20:44.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:20:44.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.700+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:44.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.730+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:20:44.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:20:44.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.796+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:20:44.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:20:44.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.815+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:44.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.827+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:20:44.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.833+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:20:44.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.838+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:44.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.891+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:20:44.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.904+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:20:44.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:20:44.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:20:44.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.937+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:20:44.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.968+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:44.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:44.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:20:45.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:20:45.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.017+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:20:45.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.026+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:20:45.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:20:45.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.057+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:45.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:20:45.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.111+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:20:45.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:45.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.146+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:45.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.160+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:20:45.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.167+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:45.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.169+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:20:45.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.192+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:20:45.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.194+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:20:45.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.211+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:20:45.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.226+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:20:45.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.231+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:20:45.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.264+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:20:45.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.281+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:20:45.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:20:45.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.291+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:20:45.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.299+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:45.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.319+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:20:45.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.337+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:20:45.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.354+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:20:45.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.377+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:20:45.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.391+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:20:45.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.419+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:45.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.434+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:20:45.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.438+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:20:45.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.453+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:20:45.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 69 16 994836 994820 901.007 926.312 0.000538404 0.00109536 2024-04-20T02:20:45.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.540+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:45.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.546+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:20:45.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.569+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:20:45.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.593+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:20:45.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:20:45.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.607+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:45.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.610+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:20:45.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.630+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:45.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.641+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:45.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:20:45.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.682+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:20:45.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.703+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:20:45.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.740+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:20:45.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.771+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:45.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.788+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:20:45.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.809+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:45.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:20:45.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.859+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:20:45.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.884+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:45.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.909+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:45.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.914+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:20:45.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.924+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:20:45.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.943+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:20:45.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.954+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:20:45.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.961+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:20:45.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.978+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:20:45.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.994+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:20:45.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:45.997+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:46.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.018+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:20:46.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.049+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:20:46.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.050+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:20:46.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.052+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:20:46.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.089+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:20:46.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.093+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:20:46.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.111+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:46.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.119+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:20:46.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.141+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:20:46.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.142+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:46.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:20:46.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.180+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:20:46.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:20:46.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.187+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:20:46.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.191+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:20:46.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:20:46.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:46.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.304+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:20:46.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.307+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:20:46.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.348+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:46.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:20:46.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.357+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:20:46.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.380+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:20:46.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:46.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.447+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:20:46.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.473+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:20:46.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.494+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:20:46.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.496+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:20:46.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 70 16 1008894 1008878 900.687 878.625 0.000628438 0.00109576 2024-04-20T02:20:46.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.527+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:46.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.530+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:20:46.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.545+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:20:46.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.561+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:20:46.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.575+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:20:46.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:20:46.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.602+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:20:46.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.602+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:20:46.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.638+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:46.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.643+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:20:46.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.653+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:46.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.675+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:20:46.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.683+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:20:46.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.693+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:20:46.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.700+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:20:46.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:20:46.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.720+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:20:46.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.727+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:20:46.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.748+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:46.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.762+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:20:46.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.775+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:20:46.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.776+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:20:46.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.795+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:20:46.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.801+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:20:46.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.836+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:20:46.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:20:46.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.857+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:46.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.865+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:20:46.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.877+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:20:46.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:20:46.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.905+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:20:46.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.907+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:20:46.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.930+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:20:46.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:20:46.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.939+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:20:46.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.962+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:20:46.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.984+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:20:46.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.986+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:20:46.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:46.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:47.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.008+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:20:47.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.021+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:20:47.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.041+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:20:47.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.078+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:20:47.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.128+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:47.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.156+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:47.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.177+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:20:47.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.194+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:20:47.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.202+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:20:47.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.207+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:20:47.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.212+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:20:47.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.253+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:20:47.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.268+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:20:47.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.280+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:47.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:20:47.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.317+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:20:47.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.324+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:20:47.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:20:47.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.347+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:47.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.370+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:20:47.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.393+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:47.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.395+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:20:47.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.427+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:20:47.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:47.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.465+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:47.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.480+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:47.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.486+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:20:47.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.500+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:20:47.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.520+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:20:47.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.521+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:20:47.525 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 71 16 1023510 1023494 900.866 913.5 0.000605203 0.00109554 2024-04-20T02:20:47.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.539+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:20:47.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.564+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:47.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.589+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:20:47.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.606+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:20:47.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.623+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:20:47.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.641+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:20:47.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:20:47.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.664+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:20:47.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.678+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:20:47.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:20:47.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.701+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:20:47.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.723+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:20:47.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.735+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:47.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.746+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:47.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.771+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:20:47.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.779+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:47.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.785+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:20:47.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.807+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:20:47.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.832+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:20:47.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.835+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:20:47.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:20:47.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.856+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:20:47.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:20:47.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.877+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:20:47.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.888+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:20:47.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:20:47.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.923+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:47.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.950+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:20:47.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:47.961+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:48.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.002+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:48.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.002+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:20:48.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.010+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:20:48.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.044+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:20:48.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.051+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:20:48.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.077+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:48.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.089+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:20:48.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.093+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:48.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.134+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:20:48.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.139+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:20:48.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.142+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:20:48.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.209+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:20:48.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:48.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.243+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:20:48.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.312+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:48.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.333+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:20:48.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.340+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:20:48.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.341+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:20:48.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:20:48.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.398+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:20:48.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.414+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:20:48.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:20:48.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.441+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:20:48.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.454+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:20:48.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.455+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:20:48.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.479+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:20:48.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.484+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:48.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.513+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:20:48.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.518+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:20:48.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.527+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:20:48.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 72 16 1037494 1037478 900.492 874 0.000912246 0.00109601 2024-04-20T02:20:48.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.537+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:20:48.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.541+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:20:48.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.564+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:20:48.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:20:48.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:20:48.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.583+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:20:48.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.613+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:20:48.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.613+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:20:48.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.656+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:20:48.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.661+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:20:48.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.681+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:20:48.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.697+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:20:48.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.713+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:20:48.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.734+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:20:48.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:20:48.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.766+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:20:48.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.786+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:48.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.795+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:20:48.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.804+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:48.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:20:48.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.831+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:20:48.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.872+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:20:48.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.877+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:20:48.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.886+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:20:48.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.916+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:48.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.917+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:48.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.936+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:20:48.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.939+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:48.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.946+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:48.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:48.970+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:49.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.021+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:49.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.039+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:20:49.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.056+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:20:49.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.058+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:20:49.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.086+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:20:49.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.110+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:20:49.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.131+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:20:49.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.171+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:49.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.209+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:20:49.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.232+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:20:49.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.254+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:20:49.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.266+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:20:49.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.273+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:20:49.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.290+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:20:49.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.312+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:20:49.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.318+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:20:49.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.340+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:20:49.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:49.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.381+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:49.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.383+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:20:49.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.410+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:49.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.411+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:49.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.434+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:20:49.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.445+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:20:49.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.478+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:20:49.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.497+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:20:49.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.502+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:20:49.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 73 16 1052153 1052137 900.706 916.188 0.0010318 0.00109576 2024-04-20T02:20:49.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.539+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:20:49.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.540+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:20:49.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.567+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:20:49.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.581+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:20:49.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.587+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:20:49.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.600+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:20:49.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.607+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:49.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.609+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:20:49.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.631+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:20:49.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.640+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:20:49.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.646+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:20:49.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.663+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:20:49.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.693+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:20:49.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.699+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:20:49.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.702+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:20:49.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.738+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:20:49.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.739+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:20:49.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.762+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:20:49.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.768+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:20:49.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.781+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:20:49.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:20:49.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.798+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:20:49.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.820+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:20:49.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.831+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:20:49.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.832+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:20:49.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.860+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:20:49.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.872+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:20:49.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.875+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:20:49.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.880+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:20:49.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.897+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:20:49.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.913+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:20:49.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:49.936+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:50.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.005+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:20:50.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.020+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:20:50.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.057+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:50.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.088+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:50.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.100+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:20:50.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.132+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:20:50.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.148+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:50.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.180+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:20:50.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.200+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:50.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.230+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:20:50.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.235+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:20:50.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.261+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:20:50.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.270+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:50.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.282+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:20:50.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.288+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:20:50.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.300+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:50.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.320+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:20:50.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.330+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:20:50.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.360+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:20:50.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.442+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:20:50.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.468+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:20:50.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.470+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:20:50.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:20:50.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.517+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:20:50.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 74 16 1066172 1066156 900.373 876.188 0.00085121 0.00109613 2024-04-20T02:20:50.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.531+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:20:50.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.554+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:20:50.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.565+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:20:50.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.587+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:20:50.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:20:50.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.698+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:50.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.718+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:20:50.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.737+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:20:50.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.744+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:20:50.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.751+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:20:50.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.754+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:20:50.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.776+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:20:50.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.778+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:20:50.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:20:50.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.813+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:20:50.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.820+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:20:50.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.844+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:20:50.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:20:50.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.870+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:20:50.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.872+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:20:50.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.910+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:50.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:20:50.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.927+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:20:50.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.938+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:20:50.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.963+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:20:50.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.964+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:20:50.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:50.972+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:20:51.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.033+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:20:51.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.036+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:20:51.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.066+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:20:51.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.077+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:20:51.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.091+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:20:51.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.117+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:20:51.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.141+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:20:51.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.163+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:51.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.184+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:20:51.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.185+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:51.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.213+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:20:51.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:20:51.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.232+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:51.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:20:51.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.279+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:20:51.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.291+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:20:51.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.320+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:20:51.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.335+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:20:51.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:20:51.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.352+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:20:51.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:20:51.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.377+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:20:51.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.408+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:20:51.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.411+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:51.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.436+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:20:51.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.476+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:51.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.494+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:20:51.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.511+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:20:51.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 75 16 1079569 1079553 899.532 837.312 0.00368144 0.00109719 2024-04-20T02:20:51.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.528+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:51.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.532+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:20:51.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.552+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:20:51.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.557+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:20:51.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.561+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:20:51.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.569+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:20:51.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:20:51.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.629+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:20:51.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.742+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:20:51.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.750+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:20:51.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.764+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:20:51.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.793+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:20:51.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.804+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:20:51.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:51.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.859+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:20:51.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.881+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:20:51.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.915+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:51.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.938+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:20:51.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.957+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:20:51.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.959+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:20:51.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:51.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:20:52.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.018+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:52.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.023+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:20:52.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.050+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:20:52.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.051+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:20:52.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.055+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:20:52.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.088+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:20:52.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.088+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:20:52.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.095+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:20:52.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.135+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:20:52.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:20:52.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.171+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:20:52.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.192+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:20:52.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.209+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:20:52.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.221+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:20:52.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:20:52.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:20:52.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:20:52.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:20:52.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.325+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:52.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.345+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:20:52.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:20:52.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.364+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:20:52.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.374+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:20:52.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.393+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:52.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.400+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:20:52.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.431+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:20:52.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.437+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:20:52.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.447+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:20:52.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.477+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:20:52.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.496+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:20:52.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.514+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:20:52.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 76 16 1092849 1092833 898.616 830 0.00133556 0.00109834 2024-04-20T02:20:52.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.571+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:20:52.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.574+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:52.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.609+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:20:52.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.633+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:20:52.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.647+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:20:52.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.682+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:20:52.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.689+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:20:52.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.696+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:20:52.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.719+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:20:52.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.730+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:52.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:20:52.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.749+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:20:52.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.771+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:20:52.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.772+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:20:52.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.809+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:20:52.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.812+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:52.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.827+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:20:52.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.846+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:20:52.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.852+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:20:52.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.886+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:20:52.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:20:52.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.909+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:20:52.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.932+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:20:52.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.952+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:20:52.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.954+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:20:52.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:52.985+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:20:53.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.007+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:20:53.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.023+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:20:53.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.028+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:20:53.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.029+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:20:53.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:20:53.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.080+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:20:53.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.081+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:20:53.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.106+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:20:53.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.122+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:20:53.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.129+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:20:53.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.145+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:53.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.180+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:20:53.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.189+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:20:53.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.211+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:20:53.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.252+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:20:53.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.267+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:20:53.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:20:53.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:20:53.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.299+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:20:53.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.306+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:20:53.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:20:53.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.346+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:20:53.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.349+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:53.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.367+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:20:53.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.378+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:20:53.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.405+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:20:53.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.411+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:53.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.421+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:20:53.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:20:53.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:20:53.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.487+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:20:53.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.497+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:20:53.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.523+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:20:53.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 77 16 1107162 1107146 898.561 894.562 0.000848567 0.0010984 2024-04-20T02:20:53.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.551+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:20:53.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.555+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:20:53.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.569+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:20:53.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.587+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:20:53.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.633+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:20:53.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.666+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:20:53.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.670+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:53.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.672+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:20:53.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.681+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:20:53.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.718+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:20:53.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.720+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:20:53.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.745+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:20:53.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.748+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:53.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:20:53.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:53.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.786+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:20:53.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.791+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:53.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.808+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:20:53.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.834+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:20:53.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.863+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:20:53.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:20:53.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.905+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:20:53.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.915+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:53.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.918+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:20:53.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.929+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:53.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.965+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:20:53.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.970+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:20:53.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.985+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:20:53.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:53.990+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:20:54.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.019+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:20:54.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.034+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:20:54.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.039+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:20:54.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.064+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:54.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.068+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:20:54.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.100+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:54.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.108+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:54.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.129+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:54.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.144+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:20:54.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.155+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:20:54.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.161+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:20:54.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.180+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:20:54.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.181+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:20:54.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.214+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:20:54.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.217+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:20:54.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.236+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:20:54.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.268+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:20:54.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.273+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:20:54.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.293+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:20:54.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.305+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:20:54.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.314+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:20:54.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:20:54.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.341+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:20:54.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.356+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:20:54.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.367+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:20:54.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:20:54.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.386+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:20:54.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.392+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:20:54.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.421+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:20:54.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.426+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:20:54.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.437+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:20:54.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:20:54.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.453+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:20:54.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.477+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:20:54.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.490+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:20:54.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.512+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:54.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 78 16 1121374 1121358 898.427 888.25 0.00066674 0.00109857 2024-04-20T02:20:54.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:20:54.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.541+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:20:54.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.556+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:20:54.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.588+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:20:54.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.613+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:20:54.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.623+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:20:54.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.681+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:20:54.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.718+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:20:54.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.731+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:54.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:20:54.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.743+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:20:54.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.759+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:20:54.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.769+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:20:54.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.785+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:20:54.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.791+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:20:54.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.804+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:20:54.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.826+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:20:54.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.865+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:20:54.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.882+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:20:54.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.891+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:20:54.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:20:54.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.940+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:54.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.949+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:20:54.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:54.979+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:20:55.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.065+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:20:55.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.079+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:20:55.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.080+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:20:55.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.110+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:20:55.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.131+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:20:55.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.136+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:20:55.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.145+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:20:55.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:55.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.162+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:20:55.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.190+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:20:55.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.217+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:20:55.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.222+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:20:55.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.225+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:20:55.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:20:55.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.268+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:20:55.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.270+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:20:55.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.281+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:20:55.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.384+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:20:55.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:20:55.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.413+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:20:55.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.423+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:20:55.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.444+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:20:55.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.463+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:20:55.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.468+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:20:55.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.475+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:20:55.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.501+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:20:55.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.501+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:20:55.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.517+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:20:55.526 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 79 16 1135881 1135865 898.53 906.688 0.000577549 0.00109843 2024-04-20T02:20:55.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.528+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:20:55.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.561+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:20:55.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.574+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:20:55.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.592+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:20:55.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.600+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:20:55.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.615+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:20:55.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.616+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:20:55.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.628+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:20:55.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.661+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:55.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.677+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:20:55.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.689+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:20:55.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.711+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:55.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.718+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:20:55.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.734+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:20:55.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.736+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:55.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.769+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:20:55.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:20:55.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.809+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:20:55.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.826+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:20:55.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.835+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:20:55.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.842+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:20:55.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.859+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:20:55.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.889+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:20:55.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.891+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:20:55.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.899+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:20:55.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.927+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:20:55.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.928+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:20:55.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:55.975+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:20:56.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.003+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:20:56.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.015+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:20:56.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.021+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:20:56.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:20:56.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.079+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:56.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.095+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:56.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.096+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:20:56.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.120+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:20:56.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.127+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:20:56.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.133+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:56.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.145+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:20:56.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.171+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:20:56.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.175+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:20:56.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.182+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:20:56.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.197+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:20:56.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.211+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:20:56.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.221+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:20:56.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.238+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:20:56.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.256+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:20:56.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.270+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:20:56.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.270+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:56.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.282+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:20:56.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.296+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:20:56.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.309+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:20:56.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.352+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:20:56.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.371+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:56.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.383+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:20:56.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:20:56.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.423+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:20:56.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.430+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:20:56.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.447+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:20:56.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.454+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:20:56.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.455+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:20:56.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:20:56.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.511+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:20:56.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.513+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:20:56.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.524+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:20:56.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:20:56.528441+0000 min lat: 0.000210708 max lat: 0.0996019 avg lat: 0.0010983 2024-04-20T02:20:56.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:20:56.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 80 16 1150371 1150355 898.618 905.625 0.000674789 0.0010983 2024-04-20T02:20:56.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.559+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:20:56.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.573+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:20:56.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.588+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:20:56.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.618+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:20:56.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.637+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:20:56.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.661+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:20:56.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.679+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:56.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.710+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:56.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.739+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:20:56.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.740+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:20:56.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.752+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:20:56.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.756+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:20:56.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.769+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:20:56.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.787+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:20:56.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:20:56.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.892+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:20:56.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.917+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:20:56.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.934+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:20:56.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.939+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:20:56.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.952+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:20:56.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.968+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:20:56.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.977+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:56.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:56.987+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:20:57.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:20:57.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.003+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:57.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.037+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:20:57.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.041+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:20:57.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.065+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:20:57.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.095+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:20:57.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.100+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:20:57.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.107+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:20:57.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.156+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:20:57.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.182+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:20:57.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.188+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:20:57.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.209+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:20:57.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.223+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:20:57.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.255+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:20:57.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.257+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:20:57.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.308+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:20:57.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.324+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:20:57.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.338+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:20:57.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.344+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:20:57.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.352+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:20:57.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.377+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:20:57.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.400+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:20:57.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:57.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:20:57.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.426+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:20:57.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.440+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:20:57.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.475+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:20:57.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.505+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:20:57.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 81 16 1164996 1164980 898.806 914.062 0.00124384 0.00109811 2024-04-20T02:20:57.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.557+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:20:57.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.573+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:20:57.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:20:57.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.583+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:20:57.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.590+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:20:57.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.608+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:20:57.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.611+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:20:57.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.613+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:20:57.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:20:57.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.669+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:20:57.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.670+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:20:57.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.691+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:20:57.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.712+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:20:57.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:20:57.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.757+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:20:57.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.773+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:20:57.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.787+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:20:57.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.834+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:20:57.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.848+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:20:57.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.872+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:20:57.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:20:57.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.896+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:57.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.920+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:20:57.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:20:57.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.937+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:20:57.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:20:57.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.978+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:20:57.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:57.999+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:20:58.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.012+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:20:58.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.033+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:58.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.046+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:20:58.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.067+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:20:58.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.086+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:20:58.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.096+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:20:58.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.114+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:20:58.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.150+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:20:58.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.166+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:20:58.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.169+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:20:58.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.174+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:20:58.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.185+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:20:58.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.200+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:20:58.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.220+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:20:58.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.245+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:20:58.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.259+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:20:58.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.269+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:20:58.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.289+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:20:58.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.290+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:20:58.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.350+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:20:58.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.372+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:20:58.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.378+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:20:58.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:20:58.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.430+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:20:58.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.445+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:20:58.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.445+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:20:58.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.474+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:20:58.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:20:58.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.504+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:20:58.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.512+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:20:58.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 82 16 1179578 1179562 898.956 911.375 0.000904935 0.00109791 2024-04-20T02:20:58.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.564+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:20:58.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.567+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:20:58.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:20:58.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.600+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:20:58.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.635+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:20:58.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.639+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:20:58.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.668+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:20:58.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.679+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:20:58.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.694+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:20:58.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.695+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:20:58.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.709+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:20:58.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.793+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:20:58.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.800+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:20:58.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.815+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:20:58.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.836+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:20:58.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:20:58.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.848+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:20:58.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.869+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:20:58.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:20:58.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.894+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:20:58.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.925+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:20:58.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.943+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:20:58.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.953+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:20:58.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:58.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:20:59.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.001+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:20:59.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.020+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:20:59.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.041+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:20:59.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.051+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:20:59.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.074+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:20:59.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.094+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:20:59.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.101+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:20:59.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.135+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:20:59.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.138+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:20:59.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.140+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:20:59.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.162+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:20:59.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.177+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:20:59.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.198+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:20:59.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.207+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:20:59.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.207+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:20:59.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.231+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:59.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.245+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:20:59.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.248+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:20:59.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.262+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:20:59.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.270+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:20:59.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.299+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:20:59.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.306+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:20:59.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.318+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:20:59.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.327+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:20:59.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:20:59.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.383+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:20:59.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.395+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:20:59.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.424+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:20:59.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.430+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:20:59.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.438+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:20:59.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:20:59.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:20:59.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.507+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:20:59.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.521+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:59.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 83 16 1192876 1192860 898.138 831.125 0.00113982 0.00109893 2024-04-20T02:20:59.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.539+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:20:59.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.544+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:20:59.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.563+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:20:59.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.566+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:20:59.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.584+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:20:59.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.603+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:20:59.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.617+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:20:59.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.627+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:20:59.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.629+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:20:59.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.641+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:20:59.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.647+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:20:59.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:20:59.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.702+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:20:59.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:20:59.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.721+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:20:59.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.724+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:20:59.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.767+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:20:59.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:20:59.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.780+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:20:59.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.799+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:20:59.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.814+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:20:59.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.820+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:20:59.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.824+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:20:59.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.830+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:20:59.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.847+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:20:59.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.866+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:20:59.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.893+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:20:59.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.894+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:20:59.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.910+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:20:59.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.935+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:20:59.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.949+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:20:59.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.955+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:20:59.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.956+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:20:59.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:20:59.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:21:00.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.011+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:21:00.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.011+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:00.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.045+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:21:00.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.054+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:21:00.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.069+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:21:00.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:00.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.087+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:00.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.107+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:21:00.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.113+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:00.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.134+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:21:00.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:00.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.165+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:21:00.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.227+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:21:00.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.246+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:00.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:00.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.264+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:21:00.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.277+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:00.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.303+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:21:00.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.332+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:21:00.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.349+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:00.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.349+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:21:00.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.359+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:00.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.370+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:21:00.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.401+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:21:00.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.411+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:00.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.418+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:21:00.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.453+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:21:00.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.453+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:21:00.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.476+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:21:00.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.491+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:00.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.502+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:00.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 84 16 1207205 1207189 898.107 895.562 0.00105943 0.00109897 2024-04-20T02:21:00.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.530+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:00.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.548+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:21:00.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.552+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:21:00.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.580+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:21:00.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.582+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:21:00.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.620+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:21:00.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.635+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:21:00.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.638+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:21:00.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:21:00.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.674+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:21:00.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.677+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:21:00.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.700+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:21:00.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.713+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:21:00.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.716+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:00.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.746+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:00.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:00.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:00.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.790+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:21:00.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:21:00.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.824+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:21:00.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.840+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:21:00.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.849+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:21:00.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:21:00.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.855+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:21:00.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.880+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:21:00.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.880+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:21:00.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.913+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:00.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:21:00.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.946+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:21:00.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.947+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:21:00.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.975+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:21:00.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:00.981+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:21:01.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.003+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:01.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.025+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:21:01.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.025+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:21:01.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.026+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:01.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.052+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:21:01.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.061+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:21:01.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.088+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:21:01.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.095+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:21:01.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.118+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:21:01.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.121+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:01.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.154+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:21:01.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.161+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:21:01.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.183+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:21:01.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.204+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:21:01.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.219+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:21:01.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.225+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:21:01.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.242+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:01.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.301+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:21:01.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.308+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:21:01.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.326+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:21:01.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.337+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:21:01.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.339+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:01.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.350+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:21:01.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.374+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:01.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.398+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:21:01.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.412+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:21:01.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.431+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:21:01.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.453+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:21:01.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.457+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:01.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.472+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:21:01.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.480+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:21:01.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.505+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:21:01.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.512+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:01.527 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 85 16 1220863 1220847 897.582 853.625 0.000887674 0.0010996 2024-04-20T02:21:01.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.532+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:21:01.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.546+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:01.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.578+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:21:01.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.624+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:21:01.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.627+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:21:01.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.641+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:21:01.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.666+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:21:01.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.692+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:21:01.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.696+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:21:01.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:21:01.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.727+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:21:01.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.758+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:21:01.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:21:01.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.771+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:21:01.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:21:01.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.814+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:21:01.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:21:01.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:21:01.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.889+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:01.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.894+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:21:01.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.928+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:21:01.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.940+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:21:01.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.968+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:21:01.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.985+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:21:01.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:01.985+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:21:02.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.002+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:02.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:21:02.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.035+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:21:02.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.047+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:02.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.099+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:21:02.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.100+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:21:02.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.105+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:21:02.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.115+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:21:02.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.152+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:02.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.164+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:02.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.181+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:21:02.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.184+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:02.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.205+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:21:02.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.222+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:02.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.222+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:02.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.251+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:02.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.267+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:21:02.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.295+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:21:02.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.298+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:21:02.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.305+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:21:02.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.311+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:21:02.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.328+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:21:02.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.364+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:21:02.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.373+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:21:02.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:21:02.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.396+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:21:02.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.409+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:21:02.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.429+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:21:02.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.457+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:21:02.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.500+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:21:02.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.516+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:21:02.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 86 16 1235208 1235192 897.568 896.562 0.000872084 0.00109963 2024-04-20T02:21:02.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.529+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:21:02.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.552+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:21:02.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:21:02.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.586+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:21:02.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.605+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:02.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.609+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:21:02.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.663+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:21:02.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.663+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:02.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.682+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:21:02.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:21:02.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.689+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:21:02.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:21:02.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.733+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:21:02.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.737+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:02.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.765+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:21:02.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.781+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:21:02.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.782+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:21:02.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.794+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:21:02.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.799+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:21:02.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.823+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:02.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.834+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:21:02.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.873+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:21:02.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.877+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:02.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.881+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:02.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.916+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:21:02.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.929+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:21:02.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.930+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:21:02.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:21:02.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.946+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:21:02.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.989+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:02.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:02.989+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:21:03.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.001+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:03.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:21:03.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.023+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:21:03.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.055+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:21:03.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.093+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:21:03.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:21:03.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:21:03.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.143+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:21:03.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.174+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:21:03.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:21:03.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.189+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:03.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.236+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:21:03.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.242+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:21:03.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.251+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:21:03.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.262+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:21:03.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.270+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:21:03.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.293+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:21:03.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.319+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:21:03.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.327+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:03.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.341+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:21:03.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:03.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.362+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:21:03.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.376+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:03.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.433+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:21:03.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.440+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:21:03.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.440+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:21:03.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.450+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:03.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.472+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:03.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.490+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:21:03.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.495+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:21:03.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 87 16 1249720 1249704 897.675 907 0.0012701 0.00109952 2024-04-20T02:21:03.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.530+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:21:03.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.539+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:21:03.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.545+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:03.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.547+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:21:03.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.567+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:21:03.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:03.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.604+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:03.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.621+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:21:03.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.638+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:03.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.660+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:21:03.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.664+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:21:03.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.685+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:21:03.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.691+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:21:03.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.727+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:21:03.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:21:03.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.766+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:03.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.771+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:21:03.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.777+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:03.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.810+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:21:03.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.814+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:21:03.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.827+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:21:03.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.833+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:21:03.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.882+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:21:03.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.884+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:21:03.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.900+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:03.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.941+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:21:03.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:21:03.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.980+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:21:03.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:03.995+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:21:04.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.023+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:04.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.041+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:04.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.042+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:04.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.063+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:21:04.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.074+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:21:04.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.099+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:21:04.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.099+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:04.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.125+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:21:04.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.136+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:21:04.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.146+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:21:04.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:21:04.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:21:04.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.171+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:21:04.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.177+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:21:04.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:21:04.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.208+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:21:04.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.242+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:04.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.260+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:21:04.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.265+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:21:04.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.267+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:04.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.283+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:04.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.302+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:21:04.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.308+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:21:04.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.332+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:21:04.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.347+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:04.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.350+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:21:04.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.362+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:21:04.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:21:04.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.387+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:21:04.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:21:04.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.405+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:04.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.430+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:21:04.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:04.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.445+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:21:04.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.463+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:21:04.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.466+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:21:04.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.487+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:21:04.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.495+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:21:04.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.526+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:21:04.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 88 16 1264308 1264292 897.833 911.75 0.00121171 0.00109933 2024-04-20T02:21:04.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.548+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:21:04.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.550+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:04.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.561+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:21:04.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.579+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:21:04.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.585+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:21:04.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:21:04.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:21:04.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.621+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:04.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.625+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:21:04.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.637+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:21:04.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.647+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:21:04.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.680+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:04.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.701+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:21:04.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.708+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:21:04.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.723+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:21:04.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.737+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:21:04.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.750+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:04.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.758+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:21:04.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.765+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:04.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.786+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:21:04.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:21:04.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:21:04.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.852+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:21:04.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.875+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:21:04.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.890+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:04.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.910+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:21:04.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.931+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:21:04.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.952+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:21:04.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.973+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:21:04.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.995+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:04.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:04.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:05.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.018+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:21:05.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.022+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:21:05.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.050+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:21:05.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.070+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:21:05.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.106+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:21:05.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.109+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:21:05.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.136+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:21:05.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.163+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:21:05.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.170+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:21:05.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.203+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:21:05.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.204+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:05.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.223+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:21:05.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.225+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:21:05.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.255+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:21:05.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:05.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.267+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:21:05.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.275+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:21:05.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.304+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:21:05.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.311+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:21:05.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:21:05.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.332+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:21:05.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:05.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.402+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:21:05.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.408+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:05.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.419+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:21:05.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.440+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:21:05.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.443+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:05.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.449+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:21:05.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.466+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:21:05.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.495+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:05.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.515+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:21:05.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 89 16 1278962 1278946 898.035 915.875 0.000645573 0.00109908 2024-04-20T02:21:05.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.555+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:21:05.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.563+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:21:05.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:21:05.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.581+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:21:05.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.601+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:21:05.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:21:05.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.636+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:21:05.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.640+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:05.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.655+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:21:05.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.657+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:21:05.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.671+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:21:05.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.687+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:21:05.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:21:05.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.716+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:21:05.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.737+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:21:05.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.774+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:21:05.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.775+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:21:05.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:21:05.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.804+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:21:05.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.822+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:21:05.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.828+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:21:05.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.849+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:21:05.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.860+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:21:05.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:05.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:21:05.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.899+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:21:05.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.914+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:05.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.918+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:21:05.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.939+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:21:05.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.954+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:05.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:05.959+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:21:06.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.004+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:06.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.005+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:21:06.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.012+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:21:06.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.022+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:06.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.043+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:21:06.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.045+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:21:06.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.072+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:21:06.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.086+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:21:06.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.105+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:21:06.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.165+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:21:06.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.183+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:21:06.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.184+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:06.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:21:06.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.266+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:06.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.276+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:21:06.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.281+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:21:06.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.355+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:06.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.357+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:21:06.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.371+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:21:06.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.391+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:21:06.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.394+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:21:06.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.438+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:06.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.439+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:21:06.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.464+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:21:06.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.493+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:21:06.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.500+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:21:06.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.513+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:21:06.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 90 16 1293066 1293050 897.85 881.5 0.000669917 0.00109932 2024-04-20T02:21:06.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.555+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:21:06.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:21:06.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.566+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:21:06.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.611+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:21:06.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:06.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:21:06.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.681+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:21:06.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.685+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:06.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.693+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:06.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.727+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:21:06.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.727+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:06.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.739+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:21:06.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.761+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:21:06.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.767+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:21:06.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.814+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:21:06.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.838+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:06.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.857+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:21:06.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.861+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:21:06.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.892+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:21:06.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:21:06.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.914+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:21:06.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.932+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:21:06.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.964+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:21:06.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.985+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:21:06.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:06.995+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:07.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.004+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:21:07.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.024+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:21:07.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.042+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:21:07.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.099+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:07.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.111+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:21:07.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.142+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:07.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.164+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:21:07.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.183+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:07.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.183+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:07.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.202+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:21:07.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.217+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:07.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.230+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:21:07.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.242+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:07.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.244+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:21:07.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.277+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:21:07.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.305+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:21:07.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.316+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:21:07.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.330+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:21:07.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.363+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:07.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.363+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:21:07.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.381+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:21:07.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.395+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:21:07.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.397+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:07.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:21:07.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:07.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.433+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:21:07.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.465+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:21:07.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.495+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:21:07.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.503+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:07.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.523+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:21:07.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 91 16 1307994 1307978 898.236 933 0.00103582 0.00109884 2024-04-20T02:21:07.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.563+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:07.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:21:07.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.589+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:07.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.591+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:21:07.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.600+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:21:07.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.619+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:21:07.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.620+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:07.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.644+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:21:07.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.691+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:21:07.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.697+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:21:07.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:21:07.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.732+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:21:07.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.740+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:21:07.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.753+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:21:07.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.775+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:21:07.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.794+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:21:07.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.808+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:07.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.819+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:21:07.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:21:07.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.878+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:21:07.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.891+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:21:07.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.891+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:07.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:21:07.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.912+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:21:07.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.927+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:07.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.940+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:21:07.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.944+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:21:07.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.984+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:07.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.989+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:21:07.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:07.994+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:21:08.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.007+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:21:08.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.011+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:08.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.043+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:21:08.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.097+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:21:08.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.097+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:21:08.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.132+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:21:08.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:08.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.153+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:21:08.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.167+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:08.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.190+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:21:08.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:08.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.205+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:21:08.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:08.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.278+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:08.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:21:08.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.298+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:21:08.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.317+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:21:08.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.339+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:21:08.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.356+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:08.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.376+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:21:08.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.394+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:21:08.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.418+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:21:08.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:21:08.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.460+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:08.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.474+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:08.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.475+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:21:08.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.500+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:21:08.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.517+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:08.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.527+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:21:08.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 92 16 1322268 1322252 898.168 892.125 0.000568383 0.00109891 2024-04-20T02:21:08.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:21:08.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.541+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:21:08.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.579+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:21:08.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.586+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:21:08.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:21:08.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.598+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:21:08.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:21:08.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.643+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:21:08.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.645+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:21:08.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.729+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:21:08.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.750+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:21:08.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.762+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:21:08.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.765+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:21:08.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:21:08.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:21:08.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.852+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:08.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.857+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:21:08.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.878+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:08.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.895+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:21:08.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.897+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:21:08.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.909+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:08.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.928+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:21:08.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.931+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:21:08.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.948+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:21:08.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.978+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:21:08.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:08.980+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:21:09.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:21:09.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.034+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:21:09.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.061+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:09.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.106+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:21:09.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.107+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:21:09.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.136+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:21:09.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.142+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:21:09.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.194+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:21:09.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.200+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:21:09.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.209+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:21:09.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:21:09.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.230+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:09.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:21:09.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.258+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:09.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.263+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:21:09.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.277+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:21:09.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.284+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:21:09.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.315+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:09.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.318+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:21:09.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.352+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:21:09.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.357+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:21:09.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.359+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:09.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:09.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.392+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:21:09.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.396+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:21:09.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.415+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:09.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.418+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:21:09.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.425+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:21:09.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.434+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:21:09.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.445+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:09.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:21:09.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.465+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:21:09.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 93 15 1337103 1337088 898.48 927.25 0.000975653 0.00109854 2024-04-20T02:21:09.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.530+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:21:09.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.541+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:21:09.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.548+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:21:09.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.577+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:21:09.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.585+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:21:09.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.677+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:21:09.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:09.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.734+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:21:09.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:21:09.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.759+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:21:09.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.770+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:21:09.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.781+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:21:09.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.826+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:21:09.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.830+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:21:09.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.890+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:21:09.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.909+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:21:09.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.925+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:21:09.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:21:09.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.949+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:21:09.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.954+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:21:09.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.982+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:21:09.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.987+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:21:09.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:09.992+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:21:10.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.001+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:10.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:21:10.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.040+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:10.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.040+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:21:10.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.056+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:10.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.073+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:21:10.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.085+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:21:10.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.086+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:21:10.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.121+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:21:10.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.148+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:10.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.194+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:21:10.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.199+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:21:10.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.208+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:21:10.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.228+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:21:10.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.241+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:21:10.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.245+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:21:10.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.258+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:21:10.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.278+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:21:10.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.315+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:10.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.327+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:21:10.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.350+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:10.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.355+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:21:10.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:21:10.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.361+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:21:10.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:21:10.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.400+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:21:10.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.447+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:21:10.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.462+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:10.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.477+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:21:10.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.490+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:21:10.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.497+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:21:10.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.508+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:10.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 94 15 1351891 1351876 898.754 924.25 0.00111684 0.00109821 2024-04-20T02:21:10.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.531+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:21:10.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.544+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:10.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.575+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:10.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.579+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:10.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.599+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:21:10.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:21:10.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.632+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:21:10.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.637+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:10.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.642+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:10.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.669+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:21:10.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.687+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:21:10.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.720+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:21:10.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.756+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:21:10.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.789+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:21:10.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.794+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:21:10.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.819+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:21:10.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.828+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:21:10.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.845+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:10.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.889+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:21:10.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.899+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:21:10.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.936+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:21:10.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.957+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:21:10.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.978+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:21:10.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.990+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:10.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:10.991+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:21:11.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.008+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:21:11.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.029+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:21:11.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.063+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:21:11.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.078+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:21:11.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.085+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:21:11.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.120+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:21:11.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.123+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:21:11.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.154+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:11.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.166+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:21:11.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:11.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:11.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.210+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:11.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.213+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:21:11.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.247+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:21:11.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.251+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:21:11.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.265+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:21:11.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.278+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:11.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:21:11.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.376+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:21:11.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.377+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:21:11.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.403+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:11.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.428+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:21:11.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:21:11.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.450+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:21:11.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.459+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:21:11.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.470+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:21:11.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.479+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:11.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:21:11.528 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 95 16 1366008 1365992 898.579 882.25 0.00138982 0.00109843 2024-04-20T02:21:11.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.543+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:21:11.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.572+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:11.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.592+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:21:11.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.606+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:11.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.624+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:21:11.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.634+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:11.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:21:11.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.654+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:21:11.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.697+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:21:11.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.705+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:21:11.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.763+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:21:11.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.813+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:21:11.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.818+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:21:11.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.861+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:21:11.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.871+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:21:11.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.879+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:21:11.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.891+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:21:11.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.941+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:21:11.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.944+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:21:11.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.968+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:21:11.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.970+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:21:11.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:11.998+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:12.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.010+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:21:12.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.013+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:21:12.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.057+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:21:12.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.063+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:21:12.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:12.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:21:12.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.101+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:21:12.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.139+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:21:12.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.155+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:21:12.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.189+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:21:12.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.213+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:12.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.268+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:21:12.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.288+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:21:12.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.297+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:12.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.313+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:21:12.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.322+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:12.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.331+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:21:12.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.336+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:21:12.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.354+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:21:12.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.380+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:21:12.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.397+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:12.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.408+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:12.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.420+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:21:12.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.446+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:21:12.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.458+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:21:12.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.479+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:21:12.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.492+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:21:12.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.492+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:21:12.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:21:12.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 96 16 1380939 1380923 898.937 933.188 0.00121927 0.00109798 2024-04-20T02:21:12.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.534+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:21:12.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.540+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:21:12.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.600+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:21:12.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.629+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:21:12.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:12.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.681+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:21:12.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.706+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:12.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.713+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:21:12.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.736+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:21:12.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.746+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:12.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.777+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:21:12.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.783+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:21:12.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.809+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:21:12.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.812+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:12.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.832+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:21:12.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.879+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:21:12.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:21:12.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.892+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:21:12.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.942+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:21:12.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.948+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:21:12.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.956+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:12.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:12.988+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:21:13.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.002+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:21:13.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.014+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:13.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.030+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:21:13.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:21:13.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.070+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:21:13.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.110+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:21:13.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.112+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:21:13.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.150+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:13.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.155+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:21:13.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.182+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:21:13.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.186+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:21:13.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.212+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:21:13.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.219+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:21:13.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.226+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:13.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.228+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:13.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.270+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:21:13.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.277+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:21:13.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.289+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:21:13.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.296+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:21:13.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.303+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:21:13.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.310+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:13.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.326+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:21:13.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.332+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:21:13.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.366+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:13.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.403+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:13.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.415+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:21:13.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.419+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:21:13.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.431+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:21:13.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:21:13.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:13.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.475+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:21:13.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.502+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:21:13.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:21:13.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 97 16 1395816 1395800 899.254 929.812 0.00165026 0.00109758 2024-04-20T02:21:13.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.543+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:13.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.553+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:21:13.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.575+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:13.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.581+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:21:13.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.645+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:21:13.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.645+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:13.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.647+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:21:13.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:13.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.741+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:21:13.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.742+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:21:13.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:21:13.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.778+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:13.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.789+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:13.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.804+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:13.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.809+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:21:13.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.825+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:21:13.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:21:13.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.872+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:13.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.879+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:21:13.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.897+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:13.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.914+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:21:13.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.919+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:21:13.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.960+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:21:13.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:21:13.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.989+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:21:13.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:13.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:21:14.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.012+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:21:14.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.022+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:14.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.052+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:21:14.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.071+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:21:14.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:21:14.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:21:14.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.097+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:21:14.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.118+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:21:14.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.123+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:21:14.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.164+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:21:14.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:21:14.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.187+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:21:14.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.212+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:21:14.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:14.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:14.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.248+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:21:14.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.255+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:21:14.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:21:14.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.301+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:21:14.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.326+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:14.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.328+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:21:14.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.334+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:21:14.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.342+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:21:14.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.375+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:14.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.403+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:21:14.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.403+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:21:14.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:21:14.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.422+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:21:14.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:21:14.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.453+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:21:14.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.481+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:21:14.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 98 16 1410566 1410550 899.484 921.875 0.000603132 0.0010973 2024-04-20T02:21:14.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.568+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:21:14.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.577+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:14.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.600+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:21:14.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:21:14.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.623+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:21:14.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:21:14.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.649+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:14.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.658+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:21:14.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.668+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:21:14.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:21:14.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.704+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:21:14.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.723+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:14.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.725+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:14.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.750+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:21:14.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.754+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:14.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.777+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:21:14.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.802+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:21:14.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:21:14.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.825+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:21:14.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.828+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:21:14.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.865+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:14.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.876+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:21:14.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.894+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:21:14.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.900+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:14.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.943+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:21:14.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.952+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:14.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.965+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:21:14.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:14.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:21:15.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.012+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:21:15.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.034+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:21:15.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.051+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:21:15.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.068+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:21:15.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.070+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:21:15.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.112+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:15.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.129+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:21:15.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.147+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:15.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.159+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:21:15.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.189+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:15.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.194+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:21:15.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.238+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:21:15.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.272+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:21:15.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.277+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:21:15.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.302+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:21:15.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.307+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:15.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.327+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:21:15.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.360+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:21:15.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.368+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:21:15.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.380+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:21:15.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.384+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:21:15.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:21:15.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.409+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:15.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.411+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:15.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:21:15.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.442+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:21:15.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.463+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:21:15.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.469+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:21:15.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.483+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:21:15.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.489+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:21:15.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.494+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:21:15.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.525+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:21:15.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.529+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:21:15.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 99 16 1424936 1424920 899.469 898.125 0.00061313 0.0010973 2024-04-20T02:21:15.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.556+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:15.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.563+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:15.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.589+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:21:15.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.596+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:21:15.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.601+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:15.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.614+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:21:15.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.633+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:21:15.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.658+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:21:15.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.664+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:15.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.722+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:15.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.741+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:15.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.748+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:15.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.759+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:15.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.790+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:21:15.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.804+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:21:15.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.833+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:15.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:21:15.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.865+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:21:15.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.877+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:15.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.879+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:21:15.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.895+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:21:15.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.927+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:21:15.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.936+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:15.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.942+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:15.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.951+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:21:15.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.953+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:21:15.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.978+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:21:15.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:15.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:21:16.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.013+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:21:16.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.014+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:21:16.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.019+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:21:16.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.045+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:16.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.074+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:16.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.094+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:16.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.111+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:16.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.136+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:21:16.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.165+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:21:16.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.166+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:21:16.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.188+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:21:16.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.201+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:16.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.204+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:21:16.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.229+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:21:16.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.264+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:21:16.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.272+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:21:16.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.295+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:16.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.304+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:16.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.315+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:21:16.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:16.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:21:16.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.380+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:21:16.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.399+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:21:16.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.401+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:21:16.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.453+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:21:16.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.499+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:21:16.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.508+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:21:16.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.512+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:21:16.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:21:16.531056+0000 min lat: 0.000210708 max lat: 0.0996019 avg lat: 0.00109719 2024-04-20T02:21:16.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:21:16.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 100 16 1439466 1439450 899.555 908.125 0.000587363 0.00109719 2024-04-20T02:21:16.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.532+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:21:16.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.550+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:21:16.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.564+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:21:16.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.574+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:21:16.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.652+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:21:16.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.658+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:16.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.682+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:21:16.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.704+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:21:16.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.718+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:16.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.745+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:21:16.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.758+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:21:16.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:21:16.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.779+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:21:16.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:21:16.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.793+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:21:16.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:21:16.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.803+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:21:16.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.847+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:21:16.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.849+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:16.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.881+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:21:16.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:21:16.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.910+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:21:16.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.932+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:21:16.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.934+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:21:16.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.955+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:21:16.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.974+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:21:16.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:16.991+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:17.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.028+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:21:17.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.041+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:21:17.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.061+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:21:17.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.065+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:21:17.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.101+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:21:17.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.111+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:21:17.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.113+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:17.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.117+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:21:17.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.143+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:17.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:17.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.171+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:21:17.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.189+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:17.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.204+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:21:17.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.209+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:21:17.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.228+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:21:17.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.229+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:17.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.237+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:17.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.268+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:17.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.303+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:21:17.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:21:17.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.347+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:21:17.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.373+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:17.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:21:17.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.461+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:21:17.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.472+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:21:17.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.492+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:21:17.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.504+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:17.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.506+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:17.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 101 16 1453876 1453860 899.565 900.625 0.000737223 0.00109718 2024-04-20T02:21:17.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.535+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:17.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.556+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:17.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.581+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:21:17.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.585+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:21:17.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.589+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:21:17.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.642+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:21:17.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.649+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:21:17.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.672+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:21:17.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:17.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.735+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:21:17.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.745+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:17.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.781+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:21:17.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:21:17.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.797+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:17.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.812+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:21:17.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.830+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:17.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.855+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:21:17.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.869+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:17.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:21:17.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.938+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:21:17.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.950+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:17.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:21:17.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.969+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:21:17.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:17.971+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:18.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.016+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:21:18.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.042+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:21:18.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.059+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:21:18.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.076+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:21:18.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.077+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:21:18.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.090+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:21:18.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.107+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:21:18.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.115+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:18.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.130+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:18.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.138+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:18.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.145+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:18.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.157+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:21:18.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.171+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:18.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.187+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:21:18.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.209+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:18.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.209+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:21:18.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.235+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:21:18.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:21:18.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.258+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:21:18.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.267+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:21:18.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.305+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:21:18.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.343+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:21:18.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.375+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:21:18.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.378+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:21:18.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.381+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:21:18.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.408+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:21:18.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:21:18.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.472+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:21:18.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:18.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:18.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.526+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:21:18.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 102 15 1468555 1468540 899.74 917.5 0.00104318 0.00109697 2024-04-20T02:21:18.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.550+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:21:18.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.561+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:21:18.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.574+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:21:18.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.598+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:21:18.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.602+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:18.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.631+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:21:18.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.656+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:21:18.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.665+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:21:18.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.671+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:21:18.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.699+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:18.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.701+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:21:18.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:21:18.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.716+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:18.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.728+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:18.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.730+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:21:18.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.752+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:21:18.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.775+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:18.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:21:18.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.809+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:21:18.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.836+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:21:18.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.841+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:21:18.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.885+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:21:18.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:18.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:21:18.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.970+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:21:18.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.989+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:21:18.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.993+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:21:18.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:18.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:21:19.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.032+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:21:19.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.034+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:21:19.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.050+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:19.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.072+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:21:19.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.095+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:19.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.116+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:21:19.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:19.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.133+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:21:19.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.152+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:21:19.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.180+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:21:19.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.193+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:19.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.221+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:19.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.236+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:19.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.304+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:21:19.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.319+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:21:19.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.339+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:19.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.342+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:21:19.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.363+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:19.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.392+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:21:19.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:21:19.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.514+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:19.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.515+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:21:19.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:21:19.529 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 103 16 1482575 1482559 899.511 876.188 0.000855594 0.00109723 2024-04-20T02:21:19.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.535+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:21:19.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.555+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:21:19.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.573+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:21:19.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.591+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:21:19.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.598+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:19.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.614+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:21:19.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.629+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:21:19.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.630+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:21:19.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.654+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:21:19.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.660+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:21:19.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.692+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:19.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.693+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:21:19.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.728+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:21:19.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.736+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:21:19.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.739+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:21:19.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.759+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:21:19.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.768+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:19.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.788+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:21:19.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.800+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:21:19.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:21:19.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.834+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:21:19.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.840+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:21:19.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.850+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:21:19.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.854+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:21:19.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.886+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:21:19.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.888+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:21:19.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.911+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:21:19.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.930+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:21:19.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.930+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:21:19.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.963+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:21:19.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.970+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:21:19.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.971+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:21:19.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:19.992+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:21:20.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.004+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:20.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.018+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:20.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.055+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:21:20.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.074+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:21:20.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:21:20.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.135+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:21:20.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.135+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:20.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.163+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:20.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:21:20.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:21:20.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.265+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:21:20.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.310+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:21:20.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.326+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:21:20.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.344+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:21:20.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:21:20.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.376+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:21:20.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:21:20.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:21:20.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.494+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:21:20.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:20.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.525+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:20.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 104 16 1495705 1495689 898.752 820.625 0.000667969 0.00109819 2024-04-20T02:21:20.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.536+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:21:20.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.543+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:21:20.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:20.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.581+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:21:20.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.614+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:20.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.626+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:21:20.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.634+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:20.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.639+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:21:20.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:21:20.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.701+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:20.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.721+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:21:20.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.727+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:21:20.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:20.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.781+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:21:20.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.814+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:21:20.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.853+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:21:20.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.867+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:21:20.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.872+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:21:20.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.883+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:21:20.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.908+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:20.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.919+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:21:20.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.924+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:21:20.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.969+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:21:20.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.994+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:21:20.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:20.998+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:21.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.015+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:21:21.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.033+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:21:21.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.047+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:21.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.053+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:21:21.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.069+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:21.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.081+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:21.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.089+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:21:21.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.149+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:21:21.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.164+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:21:21.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.165+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:21.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.180+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:21.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:21:21.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.208+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:21:21.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.221+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:21:21.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.222+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:21.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.243+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:21:21.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.281+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:21:21.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.288+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:21:21.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.402+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:21:21.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.415+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:21:21.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.418+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:21:21.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.448+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:21:21.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.449+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:21:21.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.470+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:21:21.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.483+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:21.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.512+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:21.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 105 16 1509191 1509175 898.219 842.875 0.00211963 0.00109885 2024-04-20T02:21:21.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.545+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:21:21.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:21:21.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.584+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:21:21.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.620+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:21:21.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.626+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:21:21.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.659+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:21.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.682+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:21:21.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.698+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:21.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.722+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:21.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.727+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:21:21.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.742+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:21:21.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.750+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:21:21.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.761+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:21.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.781+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:21:21.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.783+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:21.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.810+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:21:21.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.815+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:21:21.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.841+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:21:21.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.882+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:21:21.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.892+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:21.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.910+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:21.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.925+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:21:21.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.925+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:21:21.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:21:21.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.973+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:21:21.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:21.981+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:22.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.003+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:21:22.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.016+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:21:22.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.037+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:21:22.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.048+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:21:22.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.058+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:21:22.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.074+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:21:22.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.102+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:21:22.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.104+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:21:22.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.160+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:21:22.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.173+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:21:22.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.195+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:21:22.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:22.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.226+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:21:22.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:21:22.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.269+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:21:22.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.275+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:22.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.278+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:21:22.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.301+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:21:22.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.308+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:22.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.320+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:21:22.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.327+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:21:22.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:21:22.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.349+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:21:22.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.367+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:21:22.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:22.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.413+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:21:22.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.438+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:21:22.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.451+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:21:22.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.477+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:21:22.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.497+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:21:22.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.502+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:21:22.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.523+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:21:22.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.529+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:21:22.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 106 15 1523552 1523537 898.212 897.625 0.00107804 0.00109885 2024-04-20T02:21:22.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.540+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:21:22.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.582+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:21:22.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.600+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:21:22.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.626+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:21:22.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.627+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:22.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.662+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:21:22.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:22.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.709+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:21:22.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.714+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:21:22.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:21:22.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.737+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:22.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.740+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:21:22.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.757+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:22.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:21:22.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.790+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:22.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.801+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:21:22.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.812+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:21:22.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.820+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:21:22.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.834+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:22.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.850+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:21:22.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.860+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:21:22.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.884+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:21:22.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.921+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:21:22.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.928+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:21:22.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.955+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:22.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:22.975+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:21:23.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.004+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:21:23.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.024+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:21:23.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.054+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:23.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.091+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:21:23.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.103+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:23.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.123+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:23.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.146+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:21:23.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.152+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:21:23.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.184+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:21:23.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.202+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:21:23.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.212+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:21:23.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.236+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:21:23.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.241+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:23.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.278+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:23.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.283+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:21:23.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.295+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:23.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.310+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:21:23.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.321+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:21:23.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:21:23.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.356+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:21:23.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.359+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:21:23.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.390+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:23.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.394+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:21:23.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.418+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:21:23.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.436+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:23.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:21:23.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.472+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:23.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.511+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:23.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 107 16 1538190 1538174 898.366 914.812 0.00106613 0.00109867 2024-04-20T02:21:23.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.551+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:21:23.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.558+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:21:23.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.577+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:21:23.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.659+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:21:23.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.672+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:21:23.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.675+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:21:23.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.679+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:21:23.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.694+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:21:23.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.723+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:23.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:21:23.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:23.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:21:23.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.814+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:21:23.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.819+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:21:23.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.847+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:21:23.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:23.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.888+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:23.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.903+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:21:23.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:23.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.927+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:21:23.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.958+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:21:23.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.977+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:21:23.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:23.999+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:24.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.040+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:21:24.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:21:24.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.056+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:21:24.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.064+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:24.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.095+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:21:24.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:21:24.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.116+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:21:24.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.148+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:24.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.152+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:21:24.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.167+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:21:24.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.216+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:21:24.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.267+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:24.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.280+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:21:24.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.306+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:21:24.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.358+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:21:24.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.366+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:21:24.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.384+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:24.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.400+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:21:24.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.415+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:24.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:24.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.450+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:21:24.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.481+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:21:24.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.505+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:21:24.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.509+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:21:24.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 108 16 1552898 1552882 898.558 919.25 0.00081398 0.00109841 2024-04-20T02:21:24.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.537+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:21:24.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.540+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:21:24.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.561+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:21:24.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.574+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:24.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.606+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:21:24.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.636+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:21:24.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.637+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:24.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.651+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:24.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:24.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.672+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:21:24.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.691+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:21:24.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.739+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:21:24.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.756+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:24.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:21:24.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:24.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.795+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:21:24.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.815+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:24.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.848+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:21:24.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:21:24.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:21:24.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:21:24.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:24.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.914+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:24.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.931+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:21:24.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.940+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:21:24.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.955+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:21:24.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.985+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:21:24.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:24.993+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:21:25.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:21:25.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.033+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:21:25.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.044+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:21:25.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.058+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:21:25.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:21:25.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.071+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:25.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.105+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:25.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.150+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:21:25.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.152+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:21:25.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.172+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:21:25.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.213+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:21:25.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.232+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:21:25.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.248+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:21:25.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.260+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:21:25.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.266+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:21:25.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.331+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:21:25.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.344+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:21:25.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:21:25.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:21:25.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.402+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:21:25.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.405+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:21:25.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.408+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:25.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.444+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:21:25.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.446+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:25.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.462+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:21:25.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.505+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:25.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.509+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:21:25.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 109 16 1567224 1567208 898.529 895.375 0.00133059 0.00109846 2024-04-20T02:21:25.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.537+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:21:25.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.557+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:21:25.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.568+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:25.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.588+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:21:25.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.619+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:25.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.620+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:21:25.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.651+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:21:25.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.667+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:25.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.679+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:21:25.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.695+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:21:25.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.698+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:21:25.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.755+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:25.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:21:25.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:25.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.816+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:21:25.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.821+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:25.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.831+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:21:25.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.867+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:21:25.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.874+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:25.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.898+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:21:25.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.899+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:21:25.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.930+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:25.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.933+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:21:25.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.952+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:25.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:25.972+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:21:26.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.010+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:21:26.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.034+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:21:26.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.072+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:21:26.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:26.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.111+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:21:26.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.138+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:26.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.148+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:21:26.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.185+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:21:26.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.188+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:21:26.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.227+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:21:26.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:21:26.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.281+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:21:26.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.302+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:21:26.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.326+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:21:26.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:26.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.378+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:26.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.476+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:21:26.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:26.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.515+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:21:26.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.522+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:21:26.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 110 16 1581256 1581240 898.332 877 0.000796474 0.00109869 2024-04-20T02:21:26.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.547+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:21:26.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.571+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:21:26.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.571+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:21:26.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.605+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:21:26.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.614+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:21:26.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.626+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:21:26.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.648+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:26.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.656+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:21:26.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.668+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:21:26.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.675+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:21:26.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:21:26.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.699+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:21:26.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.706+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:21:26.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.729+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:21:26.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.757+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:21:26.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.761+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:21:26.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.783+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:21:26.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.791+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:26.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.807+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:21:26.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.816+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:26.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.831+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:21:26.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.853+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:21:26.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.864+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:21:26.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.882+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:26.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.883+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:21:26.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.892+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:21:26.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:26.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.916+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:21:26.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.974+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:21:26.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:26.995+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:21:27.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.035+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:21:27.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.073+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:27.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.111+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:21:27.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.116+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:21:27.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:21:27.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.149+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:21:27.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.153+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:21:27.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.187+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:21:27.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.194+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:21:27.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.207+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:21:27.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.210+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:27.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.240+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:21:27.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.256+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:21:27.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.304+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:21:27.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:21:27.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.340+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:21:27.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.357+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:21:27.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:21:27.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:21:27.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.383+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:21:27.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.393+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:21:27.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.440+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:21:27.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.471+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:21:27.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.478+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:21:27.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 111 16 1596052 1596036 898.57 924.75 0.00100412 0.0010984 2024-04-20T02:21:27.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.545+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:21:27.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.553+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:27.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.566+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:21:27.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.577+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:21:27.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.592+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:21:27.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.597+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:21:27.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.608+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:21:27.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.636+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:21:27.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.659+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:21:27.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.662+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:21:27.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.680+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:27.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.706+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:27.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:21:27.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.737+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:21:27.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:21:27.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.765+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:21:27.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.770+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:21:27.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:27.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.851+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:21:27.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.865+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:21:27.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.882+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:21:27.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.890+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:21:27.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.915+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:21:27.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.917+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:21:27.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.929+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:21:27.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.963+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:21:27.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.974+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:21:27.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:27.990+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:21:28.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.013+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:21:28.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.013+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:28.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:21:28.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.036+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:28.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.048+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:28.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:21:28.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.086+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:28.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.113+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:21:28.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.135+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:21:28.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.167+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:21:28.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.183+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:21:28.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.215+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:21:28.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.232+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:21:28.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.236+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:21:28.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.239+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:28.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.257+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:21:28.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.275+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:21:28.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.290+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:21:28.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.294+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:28.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.316+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:21:28.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:28.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.352+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:21:28.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:21:28.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:28.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.403+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:21:28.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.412+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:21:28.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.452+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:21:28.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.471+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:21:28.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.473+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:28.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.496+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:21:28.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.507+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:28.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:21:28.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 112 15 1610824 1610809 898.79 923.312 0.00056362 0.00109813 2024-04-20T02:21:28.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.551+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:21:28.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.612+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:21:28.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.622+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:28.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.629+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:21:28.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.640+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:21:28.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.683+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:28.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.706+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:28.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.750+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:21:28.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:21:28.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.777+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:28.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.779+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:28.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.790+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:21:28.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.800+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:21:28.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.824+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:21:28.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.836+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:21:28.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.841+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:21:28.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.849+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:21:28.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.866+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:28.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.886+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:21:28.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.897+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:21:28.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.898+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:28.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.921+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:28.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.934+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:21:28.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.951+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:21:28.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.974+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:28.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:28.988+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:29.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.006+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:29.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.038+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:21:29.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:21:29.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.062+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:21:29.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.071+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:21:29.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.071+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:29.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.078+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:21:29.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.087+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:21:29.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:29.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:21:29.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.166+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:21:29.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.171+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:21:29.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.197+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:21:29.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.222+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:21:29.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:21:29.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.234+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:21:29.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.236+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:21:29.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.263+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:21:29.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.286+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:21:29.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.312+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:29.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:29.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.346+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:29.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.379+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:21:29.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.379+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:21:29.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:21:29.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.411+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:21:29.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.452+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:21:29.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.470+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:21:29.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.486+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:21:29.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.518+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:21:29.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 113 16 1625839 1625823 899.14 938.375 0.0011581 0.00109769 2024-04-20T02:21:29.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.560+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:29.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.597+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:21:29.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:29.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.638+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:21:29.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.642+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:21:29.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.704+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:29.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.709+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:29.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.731+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:21:29.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.738+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:29.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:29.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.780+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:29.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.801+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:21:29.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.803+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:21:29.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.818+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:21:29.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.818+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:21:29.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:29.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.900+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:29.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:21:29.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:21:29.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.961+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:21:29.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.962+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:29.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:29.974+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:30.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.006+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:21:30.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.034+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:30.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.071+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:21:30.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.091+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:21:30.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.092+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:21:30.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:21:30.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.148+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:30.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.165+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:30.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.176+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:21:30.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.179+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:30.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.197+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:30.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.206+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:21:30.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.265+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:21:30.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.283+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:21:30.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.285+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:21:30.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.300+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:21:30.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.306+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:21:30.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.342+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:21:30.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.348+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:21:30.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:21:30.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.389+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:21:30.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.396+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:21:30.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.417+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:21:30.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.430+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:21:30.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.474+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:30.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.494+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:21:30.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.499+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:21:30.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 114 16 1640527 1640511 899.305 918 0.00128307 0.00109749 2024-04-20T02:21:30.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:30.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.565+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:30.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.625+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:21:30.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.629+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:21:30.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.643+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:21:30.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:21:30.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.656+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:21:30.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.659+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:30.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.676+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:30.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.690+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:21:30.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:21:30.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.735+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:30.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.747+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:21:30.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.770+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:21:30.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:21:30.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:21:30.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.817+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:30.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.818+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:21:30.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.830+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:21:30.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.860+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:21:30.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.862+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:21:30.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.900+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:21:30.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:21:30.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:21:30.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.943+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:21:30.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.956+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:21:30.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:30.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:31.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:21:31.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.025+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:21:31.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.038+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:21:31.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:31.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.065+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:21:31.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.083+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:21:31.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.092+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:21:31.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.117+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:21:31.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.127+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:21:31.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.150+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:31.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.165+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:21:31.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.175+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:21:31.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.179+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:31.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.204+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:31.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.225+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:31.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.226+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:21:31.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.242+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:31.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.262+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:31.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.263+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:21:31.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.299+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:21:31.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.327+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:31.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.332+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:21:31.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.355+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:21:31.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.364+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:21:31.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.373+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:31.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.392+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:31.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:31.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:21:31.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.439+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:21:31.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.453+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:21:31.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.505+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:21:31.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.509+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:31.530 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 115 15 1655304 1655289 899.515 923.625 0.000639584 0.00109722 2024-04-20T02:21:31.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.574+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:21:31.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:31.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:31.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.620+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:21:31.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.644+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:21:31.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.652+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:21:31.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:21:31.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.666+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:21:31.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.677+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:21:31.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.684+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:21:31.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.688+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:21:31.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.721+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:21:31.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:21:31.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.761+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:31.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.792+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:31.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.797+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:21:31.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:31.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.841+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:21:31.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.853+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:21:31.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.871+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:31.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:31.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.889+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:31.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.918+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:21:31.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.927+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:21:31.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.943+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:21:31.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.956+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:31.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.960+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:21:31.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:31.977+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:32.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.007+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:21:32.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:21:32.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.043+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:32.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.063+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:32.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.080+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:32.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.094+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:32.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:21:32.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.113+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:21:32.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:21:32.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.142+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:21:32.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.147+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:21:32.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.169+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:32.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.196+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:32.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.204+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:21:32.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.206+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:32.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.241+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:21:32.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.253+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:21:32.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.271+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:32.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.276+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:21:32.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.304+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:32.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.327+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:21:32.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.358+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:21:32.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.372+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:21:32.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:21:32.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.390+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:21:32.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.410+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:32.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.443+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:32.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.466+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:32.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:21:32.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.481+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:21:32.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.485+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:21:32.531 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 116 16 1670037 1670021 899.698 920.75 0.00075927 0.001097 2024-04-20T02:21:32.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:21:32.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.550+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:21:32.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.559+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:21:32.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.560+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:21:32.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.570+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:32.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:21:32.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.606+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:32.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.621+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:21:32.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.659+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:21:32.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.664+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:21:32.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.669+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:21:32.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.681+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:21:32.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:21:32.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.706+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:21:32.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:21:32.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.740+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:32.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.744+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:32.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:32.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:21:32.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.807+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:21:32.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.808+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:32.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:21:32.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.843+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:32.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.845+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:21:32.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.865+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:21:32.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.873+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:32.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:21:32.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:21:32.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.898+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:21:32.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.915+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:32.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.920+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:21:32.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.945+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:21:32.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.946+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:21:32.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.967+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:21:32.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.968+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:21:32.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:32.985+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:33.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.014+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:33.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.015+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:33.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.045+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:21:33.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.051+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:21:33.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.068+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:33.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.076+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:21:33.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.107+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:21:33.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.109+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:21:33.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.171+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:21:33.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.182+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:21:33.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.197+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:21:33.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.205+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:21:33.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.209+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:21:33.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.212+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:33.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:21:33.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.256+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:21:33.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.262+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:33.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.280+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:21:33.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.286+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:33.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.299+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:33.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.319+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:21:33.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.337+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:21:33.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.341+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:21:33.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.379+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:21:33.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.383+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:33.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:21:33.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:21:33.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.415+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:21:33.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.440+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:21:33.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.452+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:21:33.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:21:33.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.480+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:21:33.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.490+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:21:33.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.498+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:21:33.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.501+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:21:33.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.528+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:21:33.531 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 117 16 1684473 1684457 899.719 902.25 0.000726062 0.00109697 2024-04-20T02:21:33.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.552+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:21:33.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.563+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:33.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.568+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:21:33.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.588+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:21:33.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.590+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:21:33.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.640+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:21:33.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.657+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:33.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.663+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:21:33.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.678+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:33.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.725+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:21:33.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.765+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:33.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.771+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:21:33.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.788+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:21:33.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.794+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:21:33.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.797+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:33.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.807+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:21:33.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.852+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:33.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.857+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:21:33.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.860+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:33.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.863+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:33.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.879+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:21:33.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.885+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:21:33.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.906+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:21:33.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:21:33.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.920+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:33.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.931+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:21:33.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.937+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:21:33.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.946+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:21:33.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.966+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:21:33.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.977+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:21:33.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:33.984+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:21:34.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.013+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:34.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.080+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:34.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.122+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:21:34.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.127+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:34.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.136+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:21:34.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.149+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:21:34.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.169+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:21:34.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.184+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:34.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.188+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:21:34.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.208+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:21:34.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.239+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:34.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.247+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:21:34.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.251+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:21:34.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.282+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:21:34.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.289+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:21:34.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.318+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:21:34.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:21:34.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:21:34.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.356+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:21:34.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:21:34.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.390+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:21:34.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:21:34.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:21:34.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.415+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:21:34.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.425+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:21:34.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:21:34.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.491+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:21:34.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:21:34.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.494+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:21:34.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.514+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:21:34.531 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 118 16 1699082 1699066 899.831 913.062 0.000606921 0.00109683 2024-04-20T02:21:34.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.540+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:34.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.564+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:21:34.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.583+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:21:34.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.598+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:21:34.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.622+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:21:34.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.638+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:34.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.662+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:21:34.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.678+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:34.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.708+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:21:34.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.733+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:21:34.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.746+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:21:34.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:21:34.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.792+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:34.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.836+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:21:34.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.866+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:21:34.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:21:34.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.896+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:21:34.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.935+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:21:34.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.941+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:34.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.955+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:21:34.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:34.968+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:35.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.018+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:21:35.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.024+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:35.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.050+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:35.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.060+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:21:35.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.079+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:21:35.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:21:35.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.110+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:21:35.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.131+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:35.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.137+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:21:35.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.150+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:21:35.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.165+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:21:35.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.174+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:21:35.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.192+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:21:35.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:35.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.243+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:21:35.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.271+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:21:35.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.285+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:21:35.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.288+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:35.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:21:35.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.323+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:21:35.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.348+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:21:35.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.371+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:21:35.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.376+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:21:35.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.378+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:21:35.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.424+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:21:35.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.454+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:35.531 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 119 16 1712821 1712805 899.485 858.688 0.000484641 0.00109653 2024-04-20T02:21:35.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.556+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:21:35.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.607+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:21:35.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.636+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:21:35.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.694+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:21:35.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.710+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:35.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:21:35.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.730+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:21:35.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.735+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:21:35.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.768+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:35.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:21:35.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.811+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:21:35.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.838+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:21:35.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.851+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:21:35.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.861+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:35.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.874+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:35.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.891+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:21:35.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.908+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:21:35.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.910+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:35.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:35.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.934+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:35.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.973+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:21:35.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.984+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:21:35.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:35.993+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:21:36.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.023+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:21:36.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.032+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:21:36.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.060+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:21:36.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.095+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:21:36.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.102+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:21:36.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.110+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:21:36.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.147+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:36.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.161+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:21:36.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.163+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:21:36.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.178+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:21:36.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.181+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:21:36.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:21:36.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.224+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:36.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.237+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:21:36.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.237+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:21:36.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.244+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:21:36.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.302+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:21:36.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.315+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:21:36.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.326+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:21:36.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.373+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:36.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.386+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:21:36.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.398+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:21:36.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.438+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:21:36.531 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:21:36.532874+0000 min lat: 0.000210708 max lat: 0.099987 avg lat: 0.00109746 2024-04-20T02:21:36.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:21:36.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 120 16 1726216 1726200 898.965 837.188 0.000615082 0.00109746 2024-04-20T02:21:36.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:36.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.555+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:21:36.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.573+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:21:36.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.590+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:21:36.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.625+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:36.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.636+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:21:36.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.671+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:21:36.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:21:36.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.689+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:21:36.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.723+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:21:36.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:21:36.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.740+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:21:36.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.772+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:21:36.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.780+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:21:36.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.806+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:21:36.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:36.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.850+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:21:36.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.854+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:21:36.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.866+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:21:36.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:21:36.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:21:36.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.899+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:21:36.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.900+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:21:36.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.927+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:21:36.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.933+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:36.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.950+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:21:36.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:21:36.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:36.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:36.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:21:37.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.008+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:21:37.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.045+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:21:37.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.046+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:21:37.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.062+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:21:37.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.073+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:37.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:21:37.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.095+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:21:37.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:21:37.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.127+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:21:37.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.137+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:21:37.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.144+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:21:37.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.164+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:21:37.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.201+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:21:37.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.213+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:21:37.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.226+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:37.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.263+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:21:37.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:21:37.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.273+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:21:37.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.294+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:21:37.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:21:37.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.300+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:21:37.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.338+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:21:37.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.353+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:21:37.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.373+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:21:37.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.377+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:21:37.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.382+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:21:37.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.412+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:21:37.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.428+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:21:37.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.429+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:21:37.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.437+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:37.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.450+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:21:37.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.521+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:21:37.531 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 121 16 1740325 1740309 898.822 881.812 0.000556309 0.00109808 2024-04-20T02:21:37.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.549+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:37.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:21:37.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.578+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:21:37.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:21:37.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.639+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:21:37.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.655+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:21:37.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.662+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:37.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.698+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:37.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.709+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:21:37.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.714+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:21:37.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.730+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:21:37.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.783+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:21:37.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.802+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:37.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.821+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:21:37.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.826+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:21:37.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:21:37.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.837+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:21:37.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.876+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:21:37.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.904+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:37.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.918+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:21:37.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.954+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:21:37.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.966+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:21:37.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.979+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:21:37.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:37.984+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:38.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.031+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:21:38.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.042+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:21:38.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.045+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:38.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:21:38.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.060+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:38.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.087+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:21:38.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.104+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:38.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.118+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:21:38.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.135+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:38.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:38.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.234+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:38.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.238+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:21:38.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:21:38.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.309+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:21:38.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.311+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:21:38.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.337+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:38.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.355+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:38.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.381+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:21:38.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:21:38.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.419+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:38.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.419+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:21:38.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.432+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:38.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.437+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:38.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.457+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:38.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.460+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:21:38.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.465+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:21:38.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.492+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:21:38.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:21:38.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 122 16 1755189 1755173 899.067 929 0.00100071 0.00109777 2024-04-20T02:21:38.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:21:38.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.587+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:21:38.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:21:38.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.593+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:21:38.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.625+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:21:38.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.669+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:21:38.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.672+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:21:38.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:21:38.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.717+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:38.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.750+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:38.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.793+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:21:38.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.801+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:21:38.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.813+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:21:38.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.825+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:21:38.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.825+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:21:38.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.845+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:21:38.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.917+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:21:38.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:21:38.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:21:38.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.953+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:21:38.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.953+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:21:38.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.970+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:38.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.983+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:38.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:38.993+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:21:39.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.040+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:21:39.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.063+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:21:39.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.071+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:21:39.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.101+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:21:39.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.102+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:21:39.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.121+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:21:39.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.129+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:39.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.144+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:39.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:39.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.157+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:21:39.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.192+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:21:39.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.204+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:21:39.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.225+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:21:39.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.226+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:21:39.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.254+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:21:39.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.265+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:21:39.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.276+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:21:39.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.290+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:39.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.297+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:21:39.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.320+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:39.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.341+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:21:39.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.369+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:21:39.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.370+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:21:39.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.388+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:39.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.426+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:21:39.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.430+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:39.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.431+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:21:39.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.459+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:21:39.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.471+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:21:39.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.481+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:39.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.510+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:21:39.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.516+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:21:39.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 123 16 1769894 1769878 899.228 919.062 0.000974237 0.00109756 2024-04-20T02:21:39.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.535+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:21:39.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.539+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:21:39.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.554+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:39.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.563+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:21:39.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.569+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:21:39.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.582+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:39.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.594+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:21:39.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.597+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:21:39.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.614+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:21:39.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.640+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:21:39.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.641+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:21:39.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.641+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:39.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.660+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:21:39.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.682+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:21:39.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.699+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:39.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.710+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:21:39.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.715+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:21:39.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.748+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:21:39.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.757+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:39.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.772+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:39.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.787+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:21:39.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.868+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:39.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.928+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:21:39.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.940+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:39.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:21:39.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:39.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:21:40.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.005+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:21:40.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.020+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:21:40.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.027+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:21:40.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:21:40.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.056+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:40.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.070+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:21:40.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.091+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:21:40.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.104+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:21:40.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.114+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:21:40.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.119+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:21:40.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.146+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:21:40.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.153+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:21:40.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.163+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:21:40.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.172+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:21:40.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.195+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:40.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.208+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:21:40.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.223+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:40.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.229+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:21:40.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.253+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:21:40.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.263+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:21:40.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.309+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:21:40.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.310+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:40.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.336+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:40.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.393+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:21:40.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.423+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:21:40.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.436+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:21:40.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:40.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.475+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:21:40.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.483+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:21:40.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:21:40.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.532+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:21:40.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 124 16 1784330 1784314 899.251 902.25 0.0017941 0.00109755 2024-04-20T02:21:40.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.554+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:21:40.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.582+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:40.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.585+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:21:40.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:21:40.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:21:40.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.648+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:21:40.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.649+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:21:40.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.654+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:21:40.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.668+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:21:40.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.709+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:21:40.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.720+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:21:40.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.758+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:40.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.767+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:40.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.792+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:40.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.827+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:21:40.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.836+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:21:40.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.849+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:21:40.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.866+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:21:40.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.880+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:21:40.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:40.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.910+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:21:40.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.919+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:21:40.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.929+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:40.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.970+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:21:40.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:21:40.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:40.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:21:41.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.009+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:41.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.027+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:21:41.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.032+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:21:41.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.066+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:21:41.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.068+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:21:41.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.101+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:21:41.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:21:41.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.125+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:21:41.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.128+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:21:41.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.169+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:21:41.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.187+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:21:41.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.204+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:21:41.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.219+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:21:41.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.227+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:21:41.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.245+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:21:41.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.251+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:21:41.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.267+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:41.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.275+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:21:41.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.296+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:41.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.302+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:21:41.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.307+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:21:41.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.329+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:21:41.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.344+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:21:41.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:41.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.357+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:21:41.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.364+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:41.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.375+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:21:41.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.400+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:41.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:21:41.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.426+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:21:41.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.429+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:21:41.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:21:41.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.480+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:41.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.486+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:21:41.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.489+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:21:41.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 125 16 1798424 1798408 899.103 880.875 0.000395492 0.00109749 2024-04-20T02:21:41.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.670+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:41.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.671+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:21:41.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.720+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:21:41.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.722+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:21:41.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.748+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:41.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.760+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:21:41.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.772+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:21:41.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.785+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:41.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.788+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:21:41.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.814+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:41.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.834+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:21:41.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.835+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:21:41.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.870+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:41.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.882+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:21:41.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:21:41.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.949+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:21:41.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.950+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:21:41.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.971+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:21:41.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:41.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:42.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.020+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:21:42.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.022+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:21:42.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:21:42.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.053+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:21:42.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.070+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:21:42.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.098+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:21:42.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.101+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:21:42.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.119+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:21:42.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.121+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:21:42.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.146+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:21:42.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.190+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:21:42.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.193+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:42.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:21:42.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:21:42.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.252+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:42.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.260+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:21:42.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:21:42.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:42.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.323+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:42.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.329+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:42.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.354+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:21:42.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:21:42.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.383+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:21:42.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.421+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:21:42.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.474+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:42.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.488+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:42.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 126 15 1811382 1811367 898.394 809.938 0.00111245 0.0010986 2024-04-20T02:21:42.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.544+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:42.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.556+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:21:42.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.569+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:21:42.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.575+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:21:42.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.598+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:21:42.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.605+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:21:42.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.619+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:21:42.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.628+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:21:42.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.649+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:21:42.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:21:42.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.680+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:42.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.682+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:21:42.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.697+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:21:42.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.726+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:21:42.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.750+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:42.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.757+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:21:42.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.758+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:42.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.780+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:21:42.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:42.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.808+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:21:42.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.826+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:21:42.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.839+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:21:42.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.849+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:42.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.853+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:21:42.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.855+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:21:42.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.879+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:42.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.885+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:21:42.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:42.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:21:42.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:21:42.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.970+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:21:42.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:42.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:42.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:21:42.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.000+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:21:43.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.029+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:21:43.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.038+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:43.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.040+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:43.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.052+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:21:43.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.063+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:21:43.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.079+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:21:43.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.081+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:21:43.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.099+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:21:43.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.125+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:43.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.139+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:21:43.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.148+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:21:43.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.165+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:43.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.182+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:21:43.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.188+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:21:43.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.212+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:21:43.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.215+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:21:43.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.224+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:21:43.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.233+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:43.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:21:43.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.276+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:21:43.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.298+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:43.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.309+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:21:43.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:21:43.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.330+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:21:43.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.359+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:21:43.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:21:43.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.400+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:21:43.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.401+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:43.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.429+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:21:43.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.444+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:21:43.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:21:43.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.474+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:21:43.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.487+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:21:43.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.491+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:21:43.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.523+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:21:43.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 127 16 1825523 1825507 898.277 883.75 0.00107893 0.00109875 2024-04-20T02:21:43.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.556+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:21:43.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:43.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.575+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:43.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.598+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:21:43.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.609+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:21:43.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.611+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:21:43.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.624+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:43.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.625+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:21:43.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.646+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:21:43.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.647+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:21:43.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.683+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:43.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.690+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:21:43.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.712+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:43.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.721+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:43.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.730+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:21:43.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.742+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:21:43.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.744+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:21:43.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.766+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:21:43.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.767+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:43.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:21:43.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.803+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:21:43.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.813+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:21:43.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.821+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:43.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.829+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:21:43.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.867+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:21:43.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:21:43.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.896+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:21:43.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.897+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:21:43.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.924+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:21:43.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.935+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:21:43.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.937+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:21:43.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.947+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:21:43.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.971+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:21:43.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.984+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:21:43.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:43.984+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:21:44.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.019+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:21:44.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.031+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:21:44.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.039+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:21:44.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.049+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:21:44.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.057+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:21:44.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.079+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:21:44.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.121+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:21:44.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.134+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:21:44.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.149+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:44.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.206+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:21:44.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.209+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:21:44.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.227+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:21:44.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:21:44.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.245+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:21:44.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.271+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:21:44.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.286+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:21:44.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.309+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:21:44.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.311+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:21:44.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.326+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:21:44.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.350+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:21:44.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.361+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:21:44.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.370+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:21:44.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.393+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:21:44.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.402+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:21:44.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:21:44.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:44.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.451+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:21:44.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:21:44.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.522+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:44.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.526+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:44.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:21:44.532 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 128 16 1839729 1839713 898.195 887.875 0.000948845 0.00109885 2024-04-20T02:21:44.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.553+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:44.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.577+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:21:44.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.595+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:21:44.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.602+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:21:44.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.627+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:21:44.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.663+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:21:44.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.715+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:21:44.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.719+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:21:44.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.753+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:21:44.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.758+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:21:44.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.773+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:21:44.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:21:44.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.805+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:44.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.810+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:21:44.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.826+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:44.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.853+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:21:44.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.871+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:21:44.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.876+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:44.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.889+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:21:44.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.956+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:44.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.958+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:21:44.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.985+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:21:44.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:44.995+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:21:45.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.005+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:21:45.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.022+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:21:45.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.035+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:45.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.038+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:21:45.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.060+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:21:45.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.077+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:21:45.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.100+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:21:45.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.113+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:21:45.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.127+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:21:45.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.147+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:21:45.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.158+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:21:45.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.169+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:21:45.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.195+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:45.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:21:45.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.240+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:21:45.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.274+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:21:45.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.287+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:21:45.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.314+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:21:45.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:21:45.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:45.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.374+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:21:45.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.408+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:21:45.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:21:45.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.439+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:21:45.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.444+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:21:45.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.469+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:21:45.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.475+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:21:45.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.493+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:45.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.502+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:21:45.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.525+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:21:45.533 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 129 16 1854291 1854275 898.287 910.125 0.000669913 0.00109871 2024-04-20T02:21:45.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.640+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:45.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.644+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:21:45.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.665+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:21:45.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.700+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:21:45.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.704+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:45.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.722+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:21:45.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.756+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:21:45.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.782+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:21:45.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.784+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:21:45.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.797+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:21:45.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.809+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:21:45.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.822+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:21:45.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.836+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:45.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.864+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:21:45.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:45.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.883+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:45.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.901+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:45.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.919+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:21:45.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.941+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:45.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.947+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:21:45.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.952+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:21:45.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:45.958+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:21:46.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.014+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:21:46.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.014+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:21:46.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.026+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:46.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.044+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:21:46.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.054+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:21:46.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.073+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:21:46.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.102+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:21:46.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.115+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:21:46.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.116+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:21:46.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.125+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:21:46.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.165+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:21:46.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.179+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:21:46.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.182+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:21:46.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.194+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:46.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.237+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:21:46.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.249+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:21:46.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.256+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:21:46.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:21:46.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:21:46.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.294+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:21:46.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.303+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:21:46.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.342+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:46.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.347+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:21:46.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.387+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:46.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.396+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:21:46.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:21:46.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:21:46.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.427+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:21:46.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.455+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:21:46.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.461+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:21:46.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.470+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:21:46.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.471+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:21:46.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:21:46.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.520+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:21:46.533 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 130 15 1867806 1867791 897.875 844.75 0.0009514 0.00109925 2024-04-20T02:21:46.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.539+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:21:46.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.569+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:21:46.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.569+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:46.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:46.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.682+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:21:46.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.703+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:21:46.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.713+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:21:46.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:21:46.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.725+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:21:46.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:21:46.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.811+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:21:46.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.834+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:21:46.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.838+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:21:46.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.865+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:21:46.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.866+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:21:46.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.890+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:21:46.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.897+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:21:46.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.931+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:21:46.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:46.971+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:47.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.001+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:21:47.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.027+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:47.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.035+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:47.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:47.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.062+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:21:47.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.064+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:47.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.109+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:21:47.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.143+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:47.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:21:47.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.195+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:21:47.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.201+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:21:47.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.239+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:21:47.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.240+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:21:47.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.284+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:21:47.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.342+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:21:47.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:21:47.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.393+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:47.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.394+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:21:47.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.409+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:21:47.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.444+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:21:47.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.462+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:47.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.468+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:21:47.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.473+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:21:47.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.501+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:21:47.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.503+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:21:47.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.513+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:47.533 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 131 16 1881329 1881313 897.472 845.125 0.000726993 0.00109973 2024-04-20T02:21:47.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.547+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:21:47.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.563+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:21:47.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.582+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:47.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:47.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.615+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:21:47.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.643+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:21:47.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.649+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:47.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.650+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:21:47.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.667+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:47.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.680+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:21:47.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.696+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:47.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.706+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:21:47.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:21:47.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.746+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:21:47.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.769+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:47.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.770+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:47.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.820+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:21:47.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.854+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:21:47.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.889+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:21:47.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:21:47.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.920+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:47.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.939+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:21:47.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.943+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:47.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.960+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:21:47.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:21:47.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:47.988+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:21:48.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.023+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:48.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.025+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:21:48.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.032+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:21:48.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.055+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:21:48.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.057+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:48.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.081+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:21:48.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.091+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:21:48.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.118+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:21:48.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.151+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:21:48.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.171+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:21:48.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.185+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:21:48.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.197+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:21:48.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.202+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:21:48.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.237+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:48.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.251+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:21:48.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.256+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:21:48.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:21:48.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.294+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:21:48.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.304+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:21:48.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.316+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:21:48.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.361+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:21:48.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.374+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:48.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:21:48.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.382+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:21:48.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.414+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:21:48.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:21:48.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:21:48.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.440+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:21:48.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.461+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:21:48.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:21:48.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.481+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:21:48.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.531+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:21:48.533 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 132 16 1896064 1896048 897.648 920.938 0.000679557 0.00109953 2024-04-20T02:21:48.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.549+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:48.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:21:48.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.606+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:48.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.633+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:21:48.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.657+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:21:48.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.675+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:21:48.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.705+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:48.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.720+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:21:48.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:21:48.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.769+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:21:48.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.786+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:21:48.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:21:48.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.822+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:21:48.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.824+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:21:48.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.834+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:21:48.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.861+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:48.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.868+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:48.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.877+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:48.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:21:48.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.931+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:21:48.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.948+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:21:48.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:21:48.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:48.991+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:21:49.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:21:49.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.065+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:21:49.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.070+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:21:49.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:49.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:21:49.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.120+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:21:49.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.120+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:21:49.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.142+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:49.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.148+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:49.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.186+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:21:49.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.199+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:21:49.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.217+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:49.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.234+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:21:49.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:21:49.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:21:49.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.253+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:21:49.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:21:49.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.320+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:49.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.321+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:21:49.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.343+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:49.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.357+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:49.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.393+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:21:49.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.398+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:49.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.424+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:21:49.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.435+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:21:49.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:21:49.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.459+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:21:49.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:21:49.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:21:49.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.498+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:21:49.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.510+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:21:49.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.524+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:21:49.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.525+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:21:49.533 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 133 16 1910903 1910887 897.872 927.438 0.000484521 0.00109923 2024-04-20T02:21:49.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.543+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:21:49.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.556+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:21:49.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.565+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:21:49.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.581+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:49.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.585+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:21:49.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.606+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:21:49.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.640+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:21:49.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.644+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:49.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.659+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:21:49.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.677+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:21:49.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.678+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:21:49.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.691+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:49.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.715+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:21:49.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.718+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:21:49.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.740+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:21:49.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:21:49.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.759+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:21:49.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.780+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:21:49.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.781+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:21:49.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.801+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:21:49.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.802+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:21:49.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.820+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:21:49.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.828+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:21:49.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.833+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:21:49.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.873+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:21:49.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.881+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:21:49.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.900+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:21:49.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.909+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:21:49.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.930+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:21:49.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.986+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:49.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:49.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:21:50.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.010+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:50.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.029+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:21:50.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:21:50.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:21:50.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.064+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:21:50.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.070+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:21:50.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.081+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:21:50.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.084+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:21:50.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.116+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:21:50.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.131+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:21:50.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.133+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:21:50.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.133+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:21:50.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:50.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.155+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:21:50.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.174+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:21:50.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.180+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:21:50.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.186+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:21:50.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.226+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:21:50.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.246+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:21:50.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.253+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:21:50.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.285+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:21:50.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.289+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:50.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.303+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:21:50.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.315+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:21:50.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.330+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:21:50.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:21:50.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.363+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:21:50.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.370+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:21:50.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.380+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:21:50.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.388+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:21:50.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.390+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:50.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.407+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:50.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.425+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:21:50.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.450+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:21:50.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.465+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:21:50.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.491+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:21:50.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.498+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:21:50.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.512+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:21:50.533 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 134 16 1925283 1925267 897.877 898.75 0.00111163 0.00109925 2024-04-20T02:21:50.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.570+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:21:50.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.572+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:50.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:21:50.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.597+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:21:50.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.607+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:21:50.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.617+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:21:50.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.634+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:21:50.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.659+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:21:50.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.675+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:21:50.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:21:50.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:21:50.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.712+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:50.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.729+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:21:50.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.740+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:21:50.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.756+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:21:50.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.772+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:21:50.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.773+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:50.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.803+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:50.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.836+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:21:50.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.870+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:50.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.878+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:50.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.898+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:50.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.923+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:21:50.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.937+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:21:50.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.959+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:21:50.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.959+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:50.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.993+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:21:50.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:50.994+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:21:51.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.002+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:21:51.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.014+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:51.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.019+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:21:51.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.062+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:21:51.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.079+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:21:51.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.084+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:21:51.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.087+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:21:51.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.096+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:21:51.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.129+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:21:51.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.155+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:21:51.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.181+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:21:51.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.182+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:21:51.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.185+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:21:51.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:51.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.274+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:21:51.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:51.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.301+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:21:51.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:21:51.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.316+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:21:51.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:21:51.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.360+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:51.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.367+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:21:51.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.381+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:21:51.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.392+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:21:51.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:21:51.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.407+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:21:51.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.421+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:21:51.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.423+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:21:51.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.439+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:21:51.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:21:51.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.461+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:51.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:21:51.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.504+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:51.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 135 15 1939909 1939894 897.997 914.188 0.00163277 0.0010991 2024-04-20T02:21:51.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.535+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:21:51.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.545+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:51.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.577+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:21:51.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.623+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:21:51.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.626+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:21:51.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:21:51.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.641+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:21:51.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.687+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:21:51.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.690+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:21:51.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.710+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:21:51.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.738+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:21:51.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.745+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:21:51.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.769+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:21:51.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:51.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.837+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:51.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:21:51.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.885+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:21:51.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.892+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:21:51.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.905+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:21:51.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.910+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:21:51.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:21:51.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.935+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:21:51.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.943+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:21:51.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.951+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:21:51.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.974+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:51.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.977+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:21:51.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:51.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:52.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.001+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:21:52.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.005+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:21:52.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.037+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:52.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.048+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:52.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.066+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:21:52.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.087+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:52.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.092+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:52.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.099+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:21:52.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.102+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:21:52.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.111+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:21:52.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.130+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:52.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.161+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:21:52.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:21:52.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.222+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:21:52.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.250+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:52.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.269+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:21:52.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.272+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:21:52.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.301+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:52.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.302+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:21:52.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:21:52.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.327+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:21:52.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.330+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:21:52.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.358+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:21:52.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.360+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:21:52.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.367+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:21:52.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.392+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:21:52.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.407+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:21:52.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.422+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:21:52.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.434+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:21:52.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.445+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:21:52.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.450+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:21:52.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.472+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:52.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.474+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:21:52.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.490+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:21:52.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.495+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:21:52.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.515+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:21:52.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.517+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:21:52.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 136 16 1954643 1954627 898.164 920.812 0.0006924 0.00109889 2024-04-20T02:21:52.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:21:52.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.571+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:21:52.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.575+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:21:52.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.606+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:21:52.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.626+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:21:52.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.656+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:21:52.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.661+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:21:52.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.703+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:21:52.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.719+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:21:52.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.721+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:21:52.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.743+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:21:52.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.750+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:21:52.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.758+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:52.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.784+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:21:52.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.793+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:21:52.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.796+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:21:52.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.820+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:21:52.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:21:52.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.825+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:21:52.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.867+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:21:52.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.869+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:21:52.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:21:52.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.885+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:21:52.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.919+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:21:52.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.942+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:21:52.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.951+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:21:52.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.956+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:21:52.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.960+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:21:52.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.970+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:21:52.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.990+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:21:52.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:52.992+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:21:53.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.006+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:21:53.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.046+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:21:53.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.062+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:21:53.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.078+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:21:53.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.103+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:21:53.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.118+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:53.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.119+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:21:53.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.129+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:21:53.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.158+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:21:53.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.159+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:21:53.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.187+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:21:53.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.199+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:21:53.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.221+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:21:53.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.226+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:21:53.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:21:53.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.250+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:21:53.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.315+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:53.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.317+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:21:53.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.323+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:21:53.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.363+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:53.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.407+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:21:53.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.436+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:21:53.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.453+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:53.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.471+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:21:53.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.497+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:21:53.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:53.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.530+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:21:53.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 137 15 1969327 1969312 898.306 917.812 0.000629082 0.00109871 2024-04-20T02:21:53.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.547+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:21:53.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.561+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:21:53.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.632+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:53.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.651+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:21:53.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.661+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:21:53.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.664+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:21:53.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.670+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:53.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:21:53.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.697+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:21:53.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.721+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:21:53.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.742+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:21:53.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.748+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:21:53.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.763+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:21:53.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.792+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:21:53.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:21:53.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:21:53.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:21:53.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.858+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:21:53.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:21:53.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.861+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:21:53.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.870+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:21:53.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.915+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:21:53.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.915+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:21:53.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.939+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:21:53.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.939+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:53.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.954+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:21:53.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.958+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:21:53.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.966+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:21:53.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:21:53.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.990+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:21:53.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:53.994+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:21:54.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.042+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:21:54.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.061+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:21:54.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.075+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:21:54.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.085+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:21:54.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.096+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:54.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.101+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:54.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:21:54.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.125+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:21:54.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.127+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:21:54.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.179+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:21:54.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.199+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:21:54.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.202+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:21:54.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.205+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:21:54.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.239+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:21:54.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.274+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:21:54.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.293+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:21:54.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.295+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:21:54.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.305+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:21:54.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.319+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:21:54.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.325+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:21:54.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.335+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:21:54.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:21:54.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:21:54.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.360+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:21:54.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:21:54.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.381+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:21:54.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.492+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:21:54.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.516+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:21:54.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:21:54.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 138 16 1982914 1982898 897.95 849.125 0.000741327 0.00109915 2024-04-20T02:21:54.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.539+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:21:54.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.563+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:21:54.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:21:54.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.585+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:21:54.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.586+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:21:54.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.613+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:21:54.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:21:54.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.628+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:21:54.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.659+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:21:54.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.685+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:21:54.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.704+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:21:54.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.735+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:54.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.739+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:21:54.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.750+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:21:54.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.783+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:21:54.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.843+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:54.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.857+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:21:54.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.867+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:21:54.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.881+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:21:54.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.898+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:21:54.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.915+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:21:54.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.954+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:21:54.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:54.988+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:21:55.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.012+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:21:55.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.036+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:21:55.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.041+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:21:55.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.073+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:21:55.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:21:55.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:21:55.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:21:55.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.109+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:21:55.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.128+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:21:55.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.151+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:21:55.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.168+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:21:55.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.190+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:21:55.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.209+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:21:55.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.211+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:55.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.252+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:55.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.258+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:21:55.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.302+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:21:55.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.329+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:21:55.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.339+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:55.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:21:55.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.387+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:21:55.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.397+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:21:55.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.410+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:21:55.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.414+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:21:55.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.436+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:21:55.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.472+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:21:55.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.473+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:21:55.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.509+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:21:55.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.522+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:55.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.528+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:21:55.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 139 16 1997684 1997668 898.129 923.125 0.000718667 0.00109893 2024-04-20T02:21:55.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.536+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:21:55.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.652+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:21:55.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.664+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:21:55.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.681+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:21:55.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.694+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:21:55.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.726+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:21:55.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.734+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:21:55.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.743+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:55.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.762+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:21:55.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.762+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:21:55.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.773+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:21:55.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:21:55.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.796+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:21:55.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.815+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:21:55.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.818+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:21:55.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.840+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:21:55.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.840+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:21:55.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.864+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:21:55.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.891+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:21:55.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.916+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:21:55.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.939+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:21:55.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.941+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:21:55.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.953+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:21:55.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.965+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:21:55.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.981+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:21:55.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:55.988+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:21:56.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.006+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:21:56.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.039+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:21:56.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.067+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:21:56.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.072+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:21:56.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.125+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:21:56.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:21:56.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.138+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:21:56.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.152+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:21:56.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.169+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:21:56.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.175+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:21:56.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.196+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:21:56.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.215+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:21:56.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.221+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:21:56.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:56.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.271+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:21:56.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.288+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:21:56.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.321+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:21:56.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.323+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:21:56.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.337+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:21:56.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.374+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:21:56.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.385+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:21:56.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.389+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:21:56.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.413+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:21:56.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.430+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:21:56.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.433+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:21:56.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:21:56.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.493+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:21:56.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.497+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:21:56.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:21:56.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.531+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:21:56.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:21:56.535872+0000 min lat: 0.000210708 max lat: 0.126069 avg lat: 0.00109952 2024-04-20T02:21:56.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:21:56.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 140 16 2010988 2010972 897.652 831.5 0.00104893 0.00109952 2024-04-20T02:21:56.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.536+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:21:56.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.542+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:21:56.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.551+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:21:56.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.555+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:21:56.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.567+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:21:56.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.587+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:21:56.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.621+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:56.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.628+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:21:56.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:21:56.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.642+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:21:56.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.764+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:21:56.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.766+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:56.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:21:56.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.812+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:21:56.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.814+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:56.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.815+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:21:56.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.840+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:21:56.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.842+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:21:56.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.880+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:21:56.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:21:56.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:21:56.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.935+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:21:56.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:56.970+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:21:57.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.004+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:21:57.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.057+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:21:57.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.062+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:21:57.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:21:57.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.130+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:21:57.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.137+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:57.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.138+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:21:57.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.152+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:21:57.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.207+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:21:57.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.239+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:21:57.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:21:57.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.287+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:21:57.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.289+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:21:57.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.301+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:21:57.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.327+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:21:57.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.330+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:21:57.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.339+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:21:57.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.355+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:21:57.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.360+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:21:57.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.390+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:21:57.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.414+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:21:57.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.434+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:21:57.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.440+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:21:57.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.455+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:21:57.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.469+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:57.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:21:57.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.507+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:21:57.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.525+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:21:57.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.531+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:21:57.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 141 16 2024875 2024859 897.441 867.938 0.00399221 0.00109978 2024-04-20T02:21:57.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.546+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:21:57.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.553+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:21:57.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.593+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:21:57.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.606+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:21:57.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.613+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:21:57.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.658+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:21:57.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.662+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:21:57.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.705+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:21:57.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:21:57.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.723+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:21:57.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.750+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:21:57.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.766+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:21:57.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.789+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:21:57.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.810+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:21:57.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.839+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:21:57.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.845+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:21:57.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.855+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:21:57.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.856+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:21:57.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.876+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:21:57.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.886+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:21:57.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:21:57.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.913+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:21:57.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.936+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:21:57.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.956+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:21:57.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:57.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:21:58.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.007+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:21:58.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.012+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:21:58.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.034+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:21:58.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.060+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:21:58.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.090+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:21:58.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:21:58.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.111+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:21:58.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.126+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:21:58.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.126+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:21:58.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.148+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:21:58.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.176+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:21:58.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.203+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:21:58.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.207+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:21:58.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.212+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:21:58.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.226+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:21:58.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.229+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:21:58.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.262+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:21:58.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:21:58.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.278+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:21:58.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.296+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:21:58.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.297+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:21:58.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.311+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:21:58.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:21:58.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.326+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:21:58.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.360+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:21:58.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.362+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:21:58.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.367+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:21:58.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.376+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:21:58.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.390+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:21:58.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.403+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:21:58.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.426+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:21:58.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.426+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:21:58.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:21:58.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.459+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:58.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:21:58.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.500+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:21:58.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.502+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:21:58.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 142 16 2039497 2039481 897.556 913.875 0.000997118 0.00109965 2024-04-20T02:21:58.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.567+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:58.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.576+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:21:58.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.602+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:21:58.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.611+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:21:58.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.624+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:21:58.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:58.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.653+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:21:58.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:21:58.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:21:58.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.699+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:21:58.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:21:58.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.752+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:21:58.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:21:58.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.815+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:58.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.823+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:21:58.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.830+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:21:58.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.846+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:21:58.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.860+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:21:58.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.879+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:21:58.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.915+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:21:58.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.950+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:21:58.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.955+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:21:58.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.961+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:21:58.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:58.978+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:21:59.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.005+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:21:59.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.011+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:21:59.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.076+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:21:59.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.111+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:21:59.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:21:59.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.147+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:21:59.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.177+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:21:59.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.189+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:21:59.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.200+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:21:59.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.206+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:21:59.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.225+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:21:59.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.232+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:21:59.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.241+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:21:59.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.307+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:21:59.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.312+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:21:59.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.323+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:21:59.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.366+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:21:59.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.368+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:21:59.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.390+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:21:59.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.394+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:21:59.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.414+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:21:59.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.428+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:21:59.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:21:59.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.449+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:21:59.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.452+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:21:59.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.459+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:21:59.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:21:59.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.478+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:21:59.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.514+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:21:59.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.526+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:21:59.534 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 143 15 2054268 2054253 897.735 923.25 0.000858999 0.00109942 2024-04-20T02:21:59.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.549+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:21:59.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:21:59.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.612+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:21:59.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.630+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:21:59.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.642+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:21:59.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.651+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:21:59.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.666+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:21:59.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.682+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:21:59.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:21:59.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:21:59.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.735+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:21:59.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.743+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:21:59.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.769+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:21:59.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.784+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:21:59.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.795+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:21:59.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.843+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:21:59.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.849+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:21:59.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.860+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:21:59.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.885+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:21:59.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.894+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:21:59.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.942+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:21:59.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.964+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:21:59.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.966+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:21:59.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:21:59.994+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:22:00.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.020+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:22:00.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.051+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:00.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.058+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:22:00.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.064+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:22:00.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.090+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:22:00.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.095+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:22:00.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.113+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:00.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.139+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:22:00.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.170+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:22:00.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.186+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:22:00.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.212+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:00.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.226+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:22:00.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.273+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:22:00.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.288+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:22:00.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.307+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:00.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.335+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:22:00.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.337+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:22:00.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.342+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:22:00.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.372+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:22:00.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.434+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:22:00.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.441+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:22:00.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.460+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:22:00.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:22:00.535 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 144 16 2069194 2069178 897.978 932.812 0.00125908 0.00109912 2024-04-20T02:22:00.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.556+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:22:00.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.566+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:22:00.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.587+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:22:00.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:22:00.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.627+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:22:00.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.645+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:22:00.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.655+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:22:00.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.702+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:22:00.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.733+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:22:00.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.759+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:22:00.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.762+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:22:00.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.767+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:00.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.778+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:22:00.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.792+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:22:00.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.808+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:22:00.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.828+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:22:00.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.830+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:00.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.850+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:22:00.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:22:00.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:00.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.904+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:22:00.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:22:00.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.924+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:22:00.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.936+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:22:00.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.946+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:22:00.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.963+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:22:00.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.972+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:22:00.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.974+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:00.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:00.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:01.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.009+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:22:01.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:01.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.021+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:22:01.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.024+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:22:01.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:01.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.051+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:22:01.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.084+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:22:01.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.101+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:22:01.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.129+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:01.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.156+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:01.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.167+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:22:01.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.178+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:22:01.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.198+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:22:01.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.202+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:22:01.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.222+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:01.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.235+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:22:01.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.251+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:22:01.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.306+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:01.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.338+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:22:01.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.342+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:22:01.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.353+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:22:01.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.396+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:22:01.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.407+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:22:01.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.424+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:22:01.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.430+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:22:01.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.444+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:22:01.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.471+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:22:01.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.472+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:22:01.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.498+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:22:01.535 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 145 16 2083896 2083880 898.12 918.875 0.000589681 0.00109894 2024-04-20T02:22:01.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.579+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:22:01.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:22:01.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.605+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:01.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.614+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:22:01.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.617+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:22:01.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.634+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:22:01.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.642+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:22:01.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:22:01.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.718+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:22:01.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.731+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:22:01.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.748+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:22:01.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.764+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:01.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.781+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:01.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.787+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:22:01.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.803+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:01.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:01.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.840+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:22:01.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.852+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:22:01.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.859+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:22:01.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:22:01.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.930+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:22:01.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.967+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:22:01.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:22:01.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.968+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:22:01.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.994+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:01.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.998+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:22:01.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:01.999+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:22:02.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.037+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:22:02.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.056+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:02.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.056+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:02.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.074+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:22:02.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.090+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:22:02.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.102+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:02.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.117+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:22:02.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.179+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:02.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.203+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:22:02.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.236+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:22:02.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.237+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:22:02.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.251+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:22:02.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.296+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:22:02.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:22:02.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:22:02.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.365+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:22:02.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.373+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:22:02.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.390+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:22:02.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.392+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:22:02.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.442+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:02.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.459+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:22:02.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.476+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:22:02.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.485+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:22:02.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.494+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:22:02.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:22:02.535 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 146 16 2098141 2098125 898.065 890.312 0.00081139 0.00109901 2024-04-20T02:22:02.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.546+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:22:02.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.561+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:22:02.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.566+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:02.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.581+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:22:02.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.611+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:22:02.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.622+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:22:02.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.627+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:22:02.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.663+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:22:02.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.672+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:02.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:22:02.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:22:02.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.696+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:22:02.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.724+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:22:02.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.724+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:22:02.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.740+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:22:02.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.748+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:22:02.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.766+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:22:02.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.779+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:22:02.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.814+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:22:02.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.831+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:02.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:02.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:02.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.882+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:22:02.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.887+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:22:02.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.887+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:22:02.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:22:02.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.971+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:22:02.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.987+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:22:02.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:02.992+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:22:03.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.086+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:22:03.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.106+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:22:03.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.122+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:22:03.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:03.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.196+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:03.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:22:03.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.231+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:22:03.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:22:03.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.274+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:03.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.276+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:03.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.278+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:22:03.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.311+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:22:03.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.322+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:22:03.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.335+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:22:03.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.346+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:22:03.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:22:03.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.365+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:22:03.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.376+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:22:03.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.395+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:22:03.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.435+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:22:03.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.454+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:22:03.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.471+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:22:03.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.491+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:22:03.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.495+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:22:03.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.524+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:22:03.535 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 147 16 2113002 2112986 898.273 928.812 0.000723122 0.00109875 2024-04-20T02:22:03.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.542+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:22:03.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.556+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:22:03.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.589+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:22:03.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:22:03.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.621+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:03.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.646+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:22:03.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.685+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:22:03.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.700+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:22:03.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.724+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:03.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:22:03.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.757+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:03.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.769+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:22:03.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.774+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:22:03.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.775+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:03.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.825+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:22:03.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.826+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:22:03.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.838+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:03.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.849+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:22:03.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.854+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:22:03.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.871+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:22:03.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.897+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:22:03.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.916+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:22:03.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.925+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:22:03.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:22:03.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.950+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:03.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.969+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:03.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:03.990+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:22:04.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.012+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:22:04.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.014+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:22:04.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.036+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:22:04.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.040+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:22:04.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.054+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:22:04.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.078+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:22:04.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.108+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:22:04.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.123+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:22:04.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.135+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:22:04.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:22:04.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.152+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:22:04.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.184+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:22:04.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.189+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:22:04.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.220+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:22:04.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.259+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:04.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.262+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:04.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.270+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:22:04.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.289+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:22:04.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.297+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:22:04.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.316+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:22:04.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.317+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:04.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.343+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:04.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.347+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:22:04.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.362+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:22:04.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.370+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:04.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.401+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:22:04.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.407+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:22:04.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.437+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:22:04.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:22:04.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:04.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.464+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:04.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.470+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:04.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.493+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:22:04.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.502+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:22:04.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.530+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:22:04.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 148 15 2127537 2127522 898.342 908.5 0.000897995 0.00109866 2024-04-20T02:22:04.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.553+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:22:04.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.558+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:22:04.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.572+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:22:04.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.587+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:04.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.605+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:22:04.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.614+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:22:04.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.647+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:22:04.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.648+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:22:04.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.654+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:22:04.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.670+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:22:04.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:22:04.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.695+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:04.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.700+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:04.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.715+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:22:04.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.776+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:04.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.789+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:22:04.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.815+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:22:04.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.832+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:22:04.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.884+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:22:04.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.902+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:22:04.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.904+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:22:04.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.932+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:04.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.950+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:22:04.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.960+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:22:04.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:04.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:22:05.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.008+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:05.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.017+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:22:05.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.022+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:05.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.036+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:22:05.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:22:05.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.057+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:05.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.065+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:05.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:22:05.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.109+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:05.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.113+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:22:05.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.154+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:22:05.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.156+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:22:05.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.168+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:22:05.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:22:05.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.223+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:22:05.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:05.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.239+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:22:05.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.296+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:22:05.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.308+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:05.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:22:05.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.319+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:22:05.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.331+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:22:05.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.360+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:05.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.378+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:22:05.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.387+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:22:05.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.404+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:22:05.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.427+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:05.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.431+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:05.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.436+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:22:05.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.442+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:05.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.461+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:22:05.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.500+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:05.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.512+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:22:05.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.529+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:22:05.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 149 16 2142056 2142040 898.402 907.375 0.00221294 0.00109858 2024-04-20T02:22:05.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.535+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:22:05.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.541+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:05.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.777+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:22:05.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.797+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:22:05.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:22:05.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.826+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:22:05.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.840+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:22:05.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.856+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:22:05.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.861+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:22:05.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.862+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:22:05.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:22:05.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.890+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:22:05.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.906+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:22:05.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.916+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:05.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.938+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:22:05.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.954+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:22:05.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.958+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:22:05.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.964+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:22:05.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.980+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:22:05.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:05.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:22:06.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.017+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:22:06.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.025+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:22:06.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.036+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:22:06.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.053+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:22:06.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.063+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:22:06.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.098+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:22:06.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.120+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:22:06.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.136+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:22:06.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:22:06.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.174+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:22:06.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.188+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:22:06.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.229+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:22:06.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.232+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:22:06.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.293+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:22:06.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.328+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:06.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.346+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:22:06.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.381+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:22:06.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.390+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:22:06.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.409+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:22:06.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.416+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:06.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.416+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:22:06.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.443+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:22:06.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.459+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:22:06.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.473+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:22:06.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.473+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:22:06.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.483+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:06.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.493+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:22:06.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:06.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 150 16 2154640 2154624 897.655 786.5 0.000629133 0.00109951 2024-04-20T02:22:06.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.562+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:22:06.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.580+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:22:06.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.588+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:22:06.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.611+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:22:06.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.638+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:22:06.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.639+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:06.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.653+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:22:06.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.654+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:06.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.679+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:22:06.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:06.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.696+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:06.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.751+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:06.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.756+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:22:06.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.790+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:22:06.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.804+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:06.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.825+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:06.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.837+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:22:06.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.849+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:06.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.863+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:06.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.867+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:06.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:22:06.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.925+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:22:06.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.933+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:06.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.950+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:22:06.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:06.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:22:06.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:06.991+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:22:07.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.113+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:07.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.128+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:22:07.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.129+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:22:07.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.155+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:07.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.174+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:22:07.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:22:07.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:22:07.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:22:07.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.278+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:22:07.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.282+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:22:07.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.300+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:22:07.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.353+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:22:07.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.360+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:22:07.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.388+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:07.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.399+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:22:07.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.435+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:07.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.450+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:22:07.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.455+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:22:07.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.455+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:22:07.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.490+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:22:07.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.516+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:22:07.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 151 16 2168652 2168636 897.51 875.75 0.000706585 0.00109969 2024-04-20T02:22:07.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.540+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:22:07.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.570+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:22:07.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.576+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:07.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.593+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:22:07.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.655+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:07.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.722+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:22:07.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.723+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:07.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.740+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:22:07.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.760+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:22:07.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.793+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:22:07.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.799+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:22:07.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.818+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:22:07.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.830+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:22:07.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.863+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:07.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.872+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:22:07.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:07.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.904+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:22:07.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.916+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:22:07.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.930+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:22:07.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.937+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:22:07.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.944+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:07.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.976+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:22:07.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.990+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:22:07.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.992+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:07.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:07.995+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:22:08.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:08.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.036+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:08.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.065+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:22:08.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.098+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:08.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.131+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:22:08.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.178+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:22:08.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.198+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:22:08.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:22:08.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.276+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:08.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.283+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:22:08.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.319+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:08.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.348+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:22:08.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.352+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:08.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.366+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:08.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.397+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:22:08.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.415+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:22:08.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.415+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:22:08.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:08.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.440+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:22:08.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.457+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:22:08.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:22:08.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.478+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:08.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.492+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:22:08.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.497+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:22:08.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.518+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:22:08.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 152 16 2183660 2183644 897.776 938 0.001894 0.00109936 2024-04-20T02:22:08.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.537+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:22:08.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.548+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:22:08.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.570+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:22:08.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.584+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:22:08.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.617+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:08.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.631+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:22:08.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.645+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:08.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.657+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:22:08.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.667+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:22:08.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.688+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:22:08.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.690+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:22:08.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.715+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:08.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.739+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:22:08.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.753+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:22:08.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.764+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:08.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.776+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:22:08.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.780+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:22:08.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.854+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:22:08.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.855+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:22:08.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.897+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:22:08.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:22:08.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:08.940+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:22:09.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.003+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:22:09.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.014+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:09.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.029+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:09.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.056+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:22:09.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.082+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:22:09.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.099+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:22:09.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:22:09.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:22:09.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:22:09.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.187+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:22:09.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.188+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:22:09.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.208+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:09.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.218+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:22:09.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.233+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:22:09.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.236+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:22:09.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.249+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:22:09.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.254+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:22:09.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.296+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:22:09.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.319+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:22:09.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.339+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:22:09.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:22:09.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.366+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:22:09.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.376+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:22:09.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.389+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:22:09.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.399+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:22:09.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.404+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:22:09.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.430+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:09.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.466+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:09.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.482+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:22:09.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.509+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:22:09.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:09.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.522+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:09.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 153 16 2198610 2198594 898.014 934.375 0.000772236 0.00109905 2024-04-20T02:22:09.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.546+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:22:09.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.558+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:22:09.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.573+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:22:09.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.586+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:09.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.610+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:22:09.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.624+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:22:09.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.648+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:22:09.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.651+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:22:09.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.677+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:22:09.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.679+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:22:09.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.705+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:22:09.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.728+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:22:09.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.729+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:22:09.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.756+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:22:09.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:22:09.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:22:09.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.799+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:22:09.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.813+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:09.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:22:09.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:22:09.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.864+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:22:09.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.885+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:22:09.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.911+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:22:09.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.913+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:22:09.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.925+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:22:09.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.939+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:22:09.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.990+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:09.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:09.992+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:22:10.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:22:10.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.034+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:22:10.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:10.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.060+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:22:10.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.062+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:22:10.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.086+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:22:10.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.099+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:22:10.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:22:10.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.112+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:22:10.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.134+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:10.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.139+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:22:10.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.157+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:22:10.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.162+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:22:10.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.184+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:10.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.205+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:10.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.238+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:22:10.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:22:10.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.265+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:22:10.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:22:10.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.286+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:22:10.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.303+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:22:10.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:22:10.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.352+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:22:10.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.405+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:22:10.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.413+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:22:10.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:22:10.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.443+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:10.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.459+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:22:10.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.481+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:22:10.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.497+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:22:10.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.509+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:22:10.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.527+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:22:10.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.534+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:22:10.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 154 16 2213305 2213289 898.146 918.438 0.000550762 0.00109889 2024-04-20T02:22:10.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.548+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:22:10.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.566+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:10.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.568+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:22:10.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.584+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:10.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.604+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:22:10.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.608+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:10.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.609+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:22:10.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.648+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:10.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.657+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:10.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.680+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:22:10.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.704+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:10.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.728+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:22:10.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.759+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:22:10.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.784+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:22:10.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.790+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:22:10.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.807+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:22:10.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.811+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:10.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.819+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:10.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.836+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:10.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.849+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:22:10.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.866+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:22:10.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.882+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:22:10.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.884+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:22:10.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.912+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:22:10.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.916+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:22:10.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.939+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:22:10.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.958+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:10.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.969+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:10.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.978+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:22:10.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:10.979+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:11.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.002+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:22:11.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.014+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:22:11.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.015+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:22:11.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.028+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:22:11.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.039+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:22:11.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.048+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:11.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.063+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:22:11.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.073+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:11.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.120+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:22:11.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:22:11.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.141+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:11.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.164+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:22:11.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.187+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:22:11.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.197+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:22:11.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.215+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:22:11.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.224+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:22:11.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.226+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:22:11.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.269+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:22:11.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.273+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:11.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.295+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:22:11.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.320+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:22:11.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.339+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:22:11.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.341+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:22:11.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:22:11.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.390+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:22:11.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.396+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:22:11.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.407+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:22:11.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.409+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:22:11.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:22:11.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.445+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:22:11.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.451+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:11.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.464+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:22:11.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.486+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:11.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.488+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:11.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.510+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:11.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 155 16 2227620 2227604 898.123 894.688 0.000818908 0.00109893 2024-04-20T02:22:11.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.553+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:11.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.579+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:22:11.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.591+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:22:11.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.666+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:22:11.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.677+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:22:11.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:22:11.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.688+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:22:11.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.711+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:22:11.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.778+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:22:11.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:11.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.822+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:22:11.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.841+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:22:11.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.857+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:11.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.888+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:11.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.902+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:22:11.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.920+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:11.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:22:11.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.973+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:22:11.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:11.976+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:22:12.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.001+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:22:12.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.025+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:12.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.035+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:22:12.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.046+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:22:12.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.052+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:22:12.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.070+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:22:12.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.074+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:22:12.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.108+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:22:12.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.109+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:22:12.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.139+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:22:12.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.145+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:22:12.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.172+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:22:12.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.178+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:22:12.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.198+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:22:12.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.237+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:22:12.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.252+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:22:12.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.269+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:22:12.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.269+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:22:12.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.283+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:22:12.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.288+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:12.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.315+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:22:12.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.344+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:22:12.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:22:12.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.358+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:12.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.366+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:22:12.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.409+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:12.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.460+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:22:12.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.484+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:22:12.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.527+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:12.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.533+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:22:12.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 156 15 2241564 2241549 897.953 871.562 0.00159986 0.00109913 2024-04-20T02:22:12.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.567+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:22:12.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.583+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:22:12.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:22:12.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.637+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:22:12.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:12.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.660+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:22:12.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.664+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:22:12.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.689+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:22:12.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.741+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:22:12.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.764+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:12.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.789+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:22:12.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.792+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:12.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.810+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:12.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.823+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:22:12.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.855+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:22:12.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.863+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:22:12.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.880+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:22:12.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:22:12.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:22:12.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.925+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:22:12.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.954+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:22:12.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.966+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:22:12.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:12.995+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:13.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:13.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.075+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:13.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:22:13.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:13.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:13.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.126+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:22:13.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.139+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:22:13.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.189+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:22:13.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.216+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:22:13.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:22:13.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.232+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:22:13.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:13.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.286+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:22:13.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.312+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:13.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.319+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:22:13.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:13.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.341+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:13.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.350+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:22:13.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.374+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:13.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:22:13.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.379+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:13.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:13.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.418+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:22:13.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.438+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:13.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.449+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:22:13.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.458+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:22:13.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.468+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:22:13.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.476+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:22:13.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.480+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:22:13.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:13.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.493+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:13.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.512+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:22:13.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 157 16 2256232 2256216 898.071 916.688 0.000694203 0.001099 2024-04-20T02:22:13.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.562+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:13.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.575+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:22:13.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.581+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:13.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.599+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:13.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:22:13.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.621+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:22:13.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:22:13.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.655+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:22:13.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.660+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:22:13.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:22:13.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.682+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:22:13.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.711+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:22:13.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.727+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:22:13.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.729+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:22:13.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.744+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:13.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.779+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:22:13.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.787+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:22:13.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.814+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:13.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.832+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:22:13.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.844+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:22:13.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.847+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:22:13.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:22:13.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.873+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:22:13.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.910+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:22:13.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.915+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:22:13.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.961+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:22:13.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:13.986+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:22:14.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.010+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:22:14.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.027+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:22:14.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.054+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:22:14.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.067+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:22:14.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.091+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:22:14.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.118+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:22:14.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.132+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:22:14.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.143+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:14.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.165+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:22:14.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.200+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:22:14.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.219+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:22:14.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.233+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:22:14.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.239+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:14.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.247+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:22:14.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.257+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:22:14.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.272+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:22:14.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.276+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:14.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.302+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:22:14.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.307+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:14.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.321+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:22:14.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.351+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:14.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.359+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:22:14.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.384+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:22:14.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.386+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:14.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.397+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:22:14.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.421+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:22:14.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.445+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:22:14.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.448+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:22:14.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.461+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:22:14.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.461+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:22:14.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.491+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:22:14.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.500+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:22:14.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.513+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:22:14.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.531+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:22:14.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:22:14.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 158 16 2270759 2270743 898.133 907.938 0.00188948 0.00109892 2024-04-20T02:22:14.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.583+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:22:14.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:22:14.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.605+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:14.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.615+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:22:14.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.628+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:22:14.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:22:14.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.669+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:22:14.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:22:14.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.727+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:22:14.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.738+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:14.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.772+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:14.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:22:14.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.797+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:22:14.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.801+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:22:14.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.810+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:14.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.817+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:14.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.824+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:22:14.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:22:14.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.865+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:14.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.876+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:22:14.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:14.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.927+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:22:14.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.961+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:22:14.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:14.990+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:22:15.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.015+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:22:15.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.037+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:15.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.051+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:22:15.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.060+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:22:15.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.088+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:22:15.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.093+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:22:15.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.093+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:15.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.124+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:22:15.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.193+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:22:15.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.211+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:22:15.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:22:15.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:22:15.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.254+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:15.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:22:15.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.266+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:15.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.332+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:22:15.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.350+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:15.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.366+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:22:15.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.403+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:22:15.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.407+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:22:15.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:15.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.435+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:22:15.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.442+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:15.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.446+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:22:15.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.450+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:22:15.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.482+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:22:15.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.521+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:22:15.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.525+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:22:15.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.536+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:22:15.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.536+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:22:15.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 159 16 2285409 2285393 898.243 915.625 0.00058336 0.00109878 2024-04-20T02:22:15.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.545+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:22:15.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.572+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:22:15.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.578+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:15.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.586+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:22:15.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.613+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:15.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.669+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:15.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.719+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:22:15.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.764+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:22:15.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.766+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:22:15.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.796+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:22:15.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.814+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:22:15.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.819+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:15.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.830+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:22:15.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.849+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:22:15.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.862+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:22:15.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.881+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:22:15.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.881+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:22:15.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.906+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:15.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.922+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:22:15.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.944+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:22:15.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.948+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:22:15.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.971+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:15.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.987+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:15.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:15.992+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:22:16.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.003+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:22:16.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.008+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:22:16.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:16.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.028+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:22:16.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.057+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:22:16.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.058+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:16.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:16.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.120+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:22:16.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.124+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:22:16.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.125+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:22:16.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.148+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:22:16.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.168+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:22:16.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.191+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:22:16.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.210+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:22:16.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.212+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:22:16.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:16.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.239+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:16.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.252+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:16.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.274+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:22:16.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.279+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:22:16.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.291+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:16.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.343+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:22:16.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.350+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:22:16.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.367+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:22:16.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:22:16.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.381+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:16.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:22:16.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.419+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:22:16.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.432+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:22:16.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.468+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:22:16.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.489+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:22:16.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.491+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:16.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.516+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:16.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.517+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:22:16.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.527+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:22:16.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.530+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:22:16.536 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:22:16.538252+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00109879 2024-04-20T02:22:16.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:22:16.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 160 15 2299745 2299730 898.229 896.062 0.000852561 0.00109879 2024-04-20T02:22:16.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.559+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:22:16.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.568+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:22:16.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.580+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:22:16.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.608+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:22:16.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.626+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:22:16.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.630+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:22:16.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.645+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:22:16.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.654+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:22:16.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.654+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:22:16.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:22:16.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.695+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:22:16.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:16.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.713+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:16.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.730+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:22:16.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.750+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:22:16.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.754+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:22:16.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:16.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.787+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:16.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.809+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:22:16.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.822+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:22:16.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.847+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:22:16.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.873+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:22:16.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:22:16.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.927+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:22:16.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.930+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:22:16.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.942+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:16.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:16.988+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:22:17.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.019+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:22:17.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.035+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:22:17.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.037+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:22:17.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.045+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:22:17.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.052+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:22:17.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.065+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:22:17.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.072+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:22:17.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.085+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:22:17.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.100+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:22:17.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.108+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:22:17.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.123+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:22:17.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.123+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:22:17.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.130+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:22:17.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.149+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:22:17.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.159+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:22:17.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:22:17.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.180+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:17.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.207+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:22:17.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.216+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:22:17.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:22:17.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.344+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:22:17.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.368+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:22:17.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.368+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:22:17.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.388+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:22:17.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.407+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:17.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.413+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:17.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.435+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:22:17.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.461+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:17.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.467+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:22:17.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:22:17.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:22:17.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.491+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:22:17.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.496+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:17.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.525+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:22:17.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:22:17.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 161 16 2313437 2313421 897.963 855.688 0.000664287 0.00109913 2024-04-20T02:22:17.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.596+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:17.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.612+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:17.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.615+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:22:17.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.626+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:17.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.627+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:17.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.641+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:22:17.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:22:17.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.687+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:22:17.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.710+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:17.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.716+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:22:17.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.731+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:17.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.753+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:22:17.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.762+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:22:17.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.769+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:22:17.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.783+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:22:17.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.800+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:22:17.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.808+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:22:17.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.824+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:22:17.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.832+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:22:17.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.833+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:17.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.837+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:17.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.878+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:17.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.889+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:22:17.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:17.964+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:22:18.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.030+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:22:18.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.055+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:22:18.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.058+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:22:18.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.076+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:22:18.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.080+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:22:18.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.105+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:22:18.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.109+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:22:18.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:22:18.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.208+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:22:18.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.208+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:22:18.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.259+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:22:18.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.274+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:22:18.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.293+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:22:18.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.298+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:22:18.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.333+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:18.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.338+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:22:18.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.364+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:18.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.366+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:18.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.381+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:22:18.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:18.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:22:18.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.449+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:22:18.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.453+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:22:18.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.462+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:22:18.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.464+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:22:18.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.485+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:18.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.498+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:22:18.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:22:18.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 162 16 2328104 2328088 898.078 916.688 0.000790819 0.00109899 2024-04-20T02:22:18.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.553+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:18.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.557+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:22:18.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.564+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:22:18.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.589+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:22:18.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.594+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:22:18.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.623+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:22:18.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.648+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:22:18.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.663+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:18.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.696+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:22:18.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.716+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:18.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.721+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:18.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.726+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:22:18.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.741+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:22:18.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:18.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.767+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:18.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:18.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:22:18.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.856+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:22:18.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.858+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:18.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.888+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:22:18.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.913+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:18.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.925+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:18.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:22:18.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.931+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:22:18.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:22:18.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.992+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:22:18.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:18.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:19.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.011+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:22:19.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.032+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:22:19.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:19.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.059+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:22:19.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.063+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:22:19.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.077+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:22:19.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.096+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:22:19.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.098+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:22:19.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.110+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:19.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.126+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:22:19.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.130+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:19.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.144+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:22:19.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.156+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:22:19.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.176+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:22:19.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.189+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:19.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.216+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:22:19.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.239+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:22:19.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.253+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:22:19.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.290+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:19.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.303+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:22:19.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.304+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:22:19.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.330+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:22:19.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.356+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:22:19.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.376+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:22:19.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.390+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:22:19.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.405+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:22:19.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.421+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:22:19.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.426+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:22:19.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.448+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:22:19.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.449+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:22:19.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.459+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:22:19.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.460+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:22:19.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:19.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:19.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.499+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:22:19.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.530+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:19.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 163 16 2342586 2342570 898.121 905.125 0.000818619 0.00109893 2024-04-20T02:22:19.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.564+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:22:19.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.581+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:22:19.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.601+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:22:19.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.613+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:19.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.628+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:22:19.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.675+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:22:19.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.694+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:22:19.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.711+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:22:19.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.722+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:22:19.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.732+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:22:19.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.735+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:22:19.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.757+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:22:19.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.770+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:22:19.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.791+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:22:19.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:22:19.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.813+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:22:19.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:22:19.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:22:19.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:22:19.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.888+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:22:19.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.911+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:22:19.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.921+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:22:19.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.940+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:19.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.951+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:22:19.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:22:19.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:19.986+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:20.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.000+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:22:20.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.009+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:22:20.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.026+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:20.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.034+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:22:20.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.065+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:22:20.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.068+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:22:20.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.075+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:22:20.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.103+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:22:20.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.105+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:22:20.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.125+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:22:20.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.149+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:22:20.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.164+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:22:20.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.171+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:22:20.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.195+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:22:20.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.261+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:22:20.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.284+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:22:20.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.289+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:22:20.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.300+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:20.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.301+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:22:20.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:22:20.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.342+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:20.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:22:20.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.361+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:22:20.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.384+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:20.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.404+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:20.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.425+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:22:20.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.427+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:20.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.441+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:22:20.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.461+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:20.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.461+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:22:20.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:22:20.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.505+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:20.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.518+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:22:20.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 164 16 2357236 2357220 898.226 915.625 0.000710006 0.0010988 2024-04-20T02:22:20.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.551+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:20.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.566+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:22:20.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:20.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.619+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:22:20.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.629+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:22:20.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.634+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:22:20.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.661+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:20.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.672+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:20.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.707+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:22:20.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:22:20.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:22:20.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.742+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:22:20.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.858+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:20.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.867+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:22:20.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.871+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:20.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.882+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:20.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.885+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:20.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.944+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:22:20.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.957+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:22:20.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.965+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:22:20.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.981+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:22:20.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:20.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:21.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.010+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:22:21.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.024+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:22:21.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.029+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:22:21.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.036+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:22:21.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.044+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:22:21.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.063+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:22:21.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:22:21.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.088+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:22:21.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.109+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:22:21.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.119+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:22:21.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.127+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:22:21.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.131+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:22:21.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.138+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:22:21.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.156+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:21.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.168+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:22:21.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.190+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:22:21.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.223+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:22:21.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.242+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:21.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.260+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:22:21.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.285+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:22:21.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.324+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:22:21.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.331+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:22:21.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:21.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.352+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:22:21.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:21.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.418+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:21.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.419+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:22:21.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.446+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:22:21.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.500+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:22:21.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.500+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:21.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.508+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:22:21.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.534+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:22:21.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 165 15 2370438 2370423 897.783 825.188 0.00108064 0.00109935 2024-04-20T02:22:21.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.542+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:22:21.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.571+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:21.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.575+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:21.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.577+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:22:21.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.596+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:22:21.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.624+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:21.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.642+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:22:21.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:22:21.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.675+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:22:21.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.736+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:22:21.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.751+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:22:21.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.758+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:22:21.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.780+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:22:21.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.804+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:21.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.810+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:21.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.833+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:22:21.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.866+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:21.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.873+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:21.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:22:21.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.902+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:22:21.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.908+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:21.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.923+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:21.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:21.949+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:22:22.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.010+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:22:22.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.011+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:22:22.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:22:22.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.028+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:22.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:22.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.059+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:22:22.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.073+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:22:22.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:22:22.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.091+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:22:22.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.109+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:22:22.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.115+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:22:22.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.134+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:22.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.144+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:22:22.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.146+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:22:22.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.182+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:22:22.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.203+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:22:22.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.219+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:22:22.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.253+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:22:22.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.256+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:22:22.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.280+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:22.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.281+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:22:22.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.296+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:22.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.308+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:22.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.314+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:22.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.333+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:22.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.351+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:22:22.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.356+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:22:22.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.387+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:22:22.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.406+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:22:22.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.414+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:22:22.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.442+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:22:22.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:22:22.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.489+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:22:22.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.489+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:22.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.509+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:22.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.525+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:22:22.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.535+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:22.537 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 166 16 2385184 2385168 897.926 921.562 0.00297157 0.00109916 2024-04-20T02:22:22.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.571+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:22.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.599+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:22.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.634+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:22:22.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.651+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:22:22.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:22.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.668+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:22:22.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.670+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:22:22.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.697+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:22.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.717+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:22:22.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.726+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:22:22.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.728+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:22:22.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.736+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:22.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.830+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:22.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.845+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:22:22.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.859+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:22:22.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.885+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:22.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.894+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:22.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.904+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:22:22.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.907+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:22:22.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.937+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:22:22.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.963+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:22:22.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.973+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:22:22.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.993+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:22:22.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:22.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:22:23.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.018+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:23.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.031+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:22:23.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.032+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:22:23.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.065+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:22:23.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.072+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:22:23.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.081+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:23.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.085+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:23.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.119+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:23.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.141+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:22:23.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.154+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:23.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.165+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:22:23.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.204+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:22:23.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.206+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:23.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.229+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:22:23.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.255+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:22:23.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.273+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:23.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:22:23.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.300+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:22:23.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.315+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:22:23.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.320+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:23.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:22:23.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.357+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:22:23.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.360+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:23.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.389+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:22:23.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.396+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:22:23.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.409+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:23.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:22:23.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:22:23.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.451+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:22:23.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:23.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.480+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:22:23.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.487+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:22:23.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.510+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:22:23.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.516+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:22:23.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 167 16 2399894 2399878 898.053 919.375 0.000738777 0.001099 2024-04-20T02:22:23.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.541+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:22:23.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.564+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:22:23.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.567+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:23.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.591+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:23.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.600+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:22:23.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.602+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:23.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.624+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:22:23.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.643+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:22:23.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.651+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:22:23.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:23.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:22:23.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.684+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:22:23.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.698+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:22:23.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.705+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:22:23.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:22:23.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.731+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:23.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.744+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:22:23.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.746+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:22:23.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.764+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:23.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.800+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:22:23.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.802+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:22:23.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.839+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:23.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.857+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:22:23.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.862+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:22:23.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.906+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:23.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.929+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:22:23.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:22:23.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.975+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:23.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.986+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:23.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:23.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:22:24.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.001+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:22:24.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.025+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:22:24.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.039+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:22:24.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.051+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:22:24.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.079+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:22:24.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.096+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:22:24.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.107+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:22:24.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.114+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:22:24.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.116+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:22:24.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.133+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:24.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.151+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:22:24.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:24.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.163+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:22:24.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.179+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:22:24.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.183+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:22:24.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.191+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:22:24.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.215+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:22:24.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.229+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:24.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.231+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:24.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.250+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:22:24.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.265+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:22:24.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.270+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:22:24.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.293+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:22:24.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.309+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:22:24.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:22:24.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.341+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:22:24.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.351+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:24.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.373+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:24.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:22:24.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.385+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:22:24.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.401+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:22:24.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.428+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:22:24.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.431+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:22:24.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.445+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:24.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.462+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:22:24.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.465+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:22:24.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.474+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:22:24.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.497+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:24.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.508+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:22:24.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.522+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:22:24.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.533+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:24.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 168 16 2414419 2414403 898.11 907.812 0.00067002 0.00109893 2024-04-20T02:22:24.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.568+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:22:24.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.587+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:24.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.589+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:24.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.609+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:22:24.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.611+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:24.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.693+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:24.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.698+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:22:24.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.702+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:22:24.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.718+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:22:24.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.757+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:22:24.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.768+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:22:24.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.773+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:22:24.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.797+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:22:24.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.801+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:22:24.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.819+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:24.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.835+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:22:24.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.861+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:22:24.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.871+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:22:24.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.882+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:22:24.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:24.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.905+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:22:24.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.921+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:22:24.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:22:24.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.948+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:22:24.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.950+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:22:24.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.956+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:22:24.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.978+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:22:24.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.982+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:24.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:24.998+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:22:25.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.013+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:22:25.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.014+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:22:25.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.042+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:22:25.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:25.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.055+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:22:25.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.092+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:25.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.119+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:22:25.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.122+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:25.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.151+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:25.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.163+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:22:25.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.170+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:22:25.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.179+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:22:25.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.183+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:22:25.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.191+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:22:25.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:22:25.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.204+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:22:25.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:25.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.240+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:22:25.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.279+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:22:25.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.310+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:22:25.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.341+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:22:25.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.359+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:22:25.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.366+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:22:25.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.381+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:22:25.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.391+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:25.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.394+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:22:25.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.414+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:22:25.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.423+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:22:25.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.444+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:25.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:25.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:22:25.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:22:25.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.482+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:22:25.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.483+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:22:25.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.507+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:22:25.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.507+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:22:25.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.524+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:22:25.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:22:25.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 169 16 2428473 2428457 897.993 878.375 0.00121965 0.00109908 2024-04-20T02:22:25.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.551+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:22:25.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.562+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:22:25.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.579+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:22:25.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.616+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:25.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.620+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:22:25.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.645+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:22:25.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.646+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:22:25.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.648+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:25.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.672+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:22:25.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:25.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.748+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:22:25.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.781+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:22:25.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.806+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:25.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.821+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:25.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.886+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:22:25.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.903+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:22:25.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.936+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:25.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.937+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:22:25.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.937+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:22:25.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.960+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:22:25.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.972+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:22:25.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.987+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:22:25.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:25.995+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:26.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.032+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:22:26.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.034+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:26.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.056+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:22:26.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.071+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:22:26.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.084+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:22:26.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.172+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:22:26.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.186+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:22:26.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.224+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:26.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.242+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:26.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.256+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:22:26.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.265+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:22:26.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.273+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:22:26.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.285+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:22:26.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.311+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:26.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.314+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:22:26.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.355+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:26.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.364+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:22:26.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.383+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:22:26.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.420+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:22:26.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:22:26.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:22:26.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.454+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:26.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.469+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:22:26.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.489+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:26.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.492+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:22:26.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:22:26.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 170 15 2442412 2442397 897.835 871.25 0.000760927 0.00109928 2024-04-20T02:22:26.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.543+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:22:26.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.552+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:22:26.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.558+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:22:26.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.568+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:22:26.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.588+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:26.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.612+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:22:26.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.617+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:22:26.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.631+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:22:26.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.644+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:26.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:22:26.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:22:26.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:22:26.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.754+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:26.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.759+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:22:26.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.792+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:22:26.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.802+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:26.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.855+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:22:26.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.866+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:22:26.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:22:26.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.896+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:22:26.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.913+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:22:26.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.925+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:22:26.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.942+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:26.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.968+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:22:26.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:26.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:22:27.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.010+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:22:27.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.017+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:22:27.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.023+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:27.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.066+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:22:27.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:27.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.093+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:27.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.098+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:27.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.121+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:22:27.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.156+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:22:27.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.185+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:22:27.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.212+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:22:27.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.218+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:27.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.256+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:22:27.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.264+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:22:27.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.278+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:22:27.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.281+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:27.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.298+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:22:27.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.316+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:22:27.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:27.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.341+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:22:27.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.352+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:22:27.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.353+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:22:27.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.372+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:22:27.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.388+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:22:27.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.404+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:22:27.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.430+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:22:27.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.434+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:22:27.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.444+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:22:27.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.463+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:22:27.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.487+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:22:27.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.495+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:22:27.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.516+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:22:27.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 171 16 2456997 2456981 897.915 911.5 0.000514953 0.00109918 2024-04-20T02:22:27.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.551+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:22:27.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.579+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:22:27.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.582+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:22:27.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.609+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:27.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.624+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:22:27.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.644+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:22:27.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.662+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:22:27.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:22:27.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.703+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:22:27.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.720+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:22:27.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.721+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:27.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.724+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:22:27.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.761+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:22:27.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.778+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:22:27.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.796+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:22:27.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.837+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:22:27.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.882+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:22:27.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:22:27.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.895+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:22:27.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.927+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:22:27.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.940+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:27.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.941+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:22:27.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.964+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:22:27.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.964+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:22:27.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.972+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:22:28.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:27.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:22:28.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.013+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:22:28.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.018+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:22:28.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:22:28.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.060+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:28.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.068+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:28.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.080+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:22:28.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.090+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:28.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.103+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:22:28.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.135+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:22:28.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.136+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:22:28.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.162+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:22:28.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.197+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:28.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.201+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:22:28.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.214+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:22:28.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.227+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:22:28.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:22:28.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.261+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:22:28.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.282+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:22:28.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.313+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:22:28.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.332+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:22:28.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.338+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:22:28.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:22:28.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.377+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:22:28.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.377+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:22:28.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.393+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:22:28.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.434+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:22:28.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:22:28.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.458+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:22:28.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.470+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:28.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.477+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:22:28.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.496+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:22:28.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.509+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:22:28.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.525+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:22:28.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.525+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:22:28.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.533+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:22:28.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 172 16 2471748 2471732 898.053 921.938 0.001537 0.001099 2024-04-20T02:22:28.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.540+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:28.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.565+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:22:28.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.596+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:22:28.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.622+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:22:28.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.623+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:28.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:22:28.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.707+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:22:28.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.752+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:22:28.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:22:28.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.760+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:28.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:22:28.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.810+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:22:28.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.823+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:22:28.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.830+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:22:28.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.863+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:22:28.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.863+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:22:28.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.895+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:22:28.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.926+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:22:28.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.934+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:22:28.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.939+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:22:28.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.958+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:22:28.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:28.974+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:29.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.001+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:22:29.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.029+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:22:29.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:22:29.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.055+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:22:29.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.080+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:22:29.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.121+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:22:29.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.130+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:29.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.166+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:22:29.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.168+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:22:29.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.192+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:22:29.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.214+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:22:29.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:22:29.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.246+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:22:29.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.278+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:22:29.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.291+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:22:29.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.315+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:22:29.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.325+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:29.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.348+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:22:29.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.360+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:22:29.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.391+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:22:29.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:22:29.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.407+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:29.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.452+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:22:29.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.462+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:22:29.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.481+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:22:29.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.507+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:22:29.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.521+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:22:29.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.532+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:22:29.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 173 16 2486402 2486386 898.155 915.875 0.00078189 0.00109888 2024-04-20T02:22:29.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.548+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:22:29.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.553+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:29.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:22:29.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.573+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:29.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.600+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:22:29.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.608+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:22:29.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.629+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:29.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.673+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:22:29.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:22:29.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:22:29.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.724+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:22:29.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:22:29.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.829+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:29.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.839+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:22:29.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.847+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:22:29.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.860+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:22:29.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.880+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:22:29.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.911+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:22:29.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.942+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:22:29.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:29.995+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:22:30.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.017+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:22:30.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.053+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:22:30.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.054+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:30.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.068+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:22:30.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.077+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:22:30.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.092+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:30.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.101+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:22:30.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.103+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:22:30.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.133+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:22:30.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.153+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:30.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.154+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:22:30.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.169+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:22:30.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.185+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:22:30.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.194+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:22:30.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.206+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:22:30.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.210+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:22:30.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.234+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:30.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.252+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:30.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.261+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:22:30.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.284+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:22:30.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.296+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:22:30.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.297+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:22:30.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:30.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:22:30.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.373+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:22:30.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.398+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:22:30.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.406+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:30.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.421+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:22:30.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.423+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:30.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:30.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.453+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:22:30.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.483+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:22:30.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.504+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:22:30.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.508+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:30.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.535+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:22:30.538 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 174 16 2501273 2501257 898.334 929.438 0.000935166 0.00109866 2024-04-20T02:22:30.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.578+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:22:30.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:22:30.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.622+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:30.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.628+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:22:30.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.639+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:22:30.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.656+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:22:30.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.660+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:22:30.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.688+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:22:30.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.727+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:22:30.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:22:30.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.760+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:22:30.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.774+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:30.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:22:30.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.830+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:30.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:30.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.847+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:30.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.851+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:22:30.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.853+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:22:30.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.885+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:22:30.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.888+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:30.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:22:30.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.922+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:22:30.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:22:30.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.954+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:30.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:30.973+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:22:31.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:31.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.014+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:22:31.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.016+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:22:31.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:22:31.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.033+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:22:31.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.061+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:31.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.062+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:22:31.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.067+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:31.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.094+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:31.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.124+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:22:31.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.143+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:31.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.169+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:31.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.199+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:22:31.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.213+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:22:31.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.215+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:22:31.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.240+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:31.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.248+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:31.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.258+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:22:31.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.268+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:22:31.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.299+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:31.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.302+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:22:31.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.354+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:31.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.364+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:31.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.397+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:22:31.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.420+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:22:31.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.420+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:22:31.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.456+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:22:31.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.473+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:22:31.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.489+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:31.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.499+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:22:31.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.518+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:31.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 175 16 2515894 2515878 898.422 913.812 0.000744712 0.00109856 2024-04-20T02:22:31.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.543+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:22:31.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.556+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:22:31.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.565+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:22:31.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:22:31.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.670+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:22:31.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.683+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:22:31.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.694+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:22:31.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.702+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:31.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:22:31.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.730+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:22:31.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.733+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:31.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.781+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:31.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.789+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:22:31.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.793+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:22:31.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:31.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.826+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:22:31.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.837+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:31.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.867+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:22:31.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.895+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:31.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:22:31.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.922+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:22:31.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.925+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:22:31.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.937+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:31.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.951+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:22:31.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.963+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:22:31.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:31.989+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:22:32.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.001+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:32.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.016+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:22:32.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.023+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:22:32.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.035+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:22:32.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.069+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:22:32.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:22:32.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.117+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:22:32.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.131+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:22:32.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:32.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.165+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:22:32.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.170+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:22:32.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.218+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:22:32.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.233+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:22:32.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.235+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:32.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.261+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:22:32.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.263+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:32.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.288+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:32.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.293+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:22:32.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.310+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:22:32.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.313+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:22:32.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.333+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:22:32.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.341+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:22:32.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.371+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:22:32.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.414+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:22:32.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.415+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:22:32.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.438+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:22:32.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.450+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:22:32.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:22:32.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.465+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:22:32.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.496+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:22:32.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.499+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:22:32.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.512+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:32.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.516+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:22:32.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.533+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:22:32.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 176 16 2530144 2530128 898.378 890.625 0.0012399 0.00109861 2024-04-20T02:22:32.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.545+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:32.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.562+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:22:32.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.563+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:22:32.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.600+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:22:32.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.660+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:22:32.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.671+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:22:32.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.685+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:22:32.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.691+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:22:32.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.707+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:22:32.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:22:32.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.724+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:32.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:32.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.742+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:22:32.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.787+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:32.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.789+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:22:32.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.814+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:22:32.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.833+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:22:32.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.846+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:22:32.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.861+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:22:32.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.897+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:22:32.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.922+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:22:32.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.933+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:32.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:32.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.974+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:22:32.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:32.994+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:22:33.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.007+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:22:33.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:33.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.028+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:22:33.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:22:33.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.075+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:33.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.110+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:22:33.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.111+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:22:33.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.134+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:22:33.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:22:33.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:22:33.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.178+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:22:33.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.180+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:22:33.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.215+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:22:33.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.221+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:22:33.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.253+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:22:33.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.265+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:22:33.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.268+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:22:33.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.290+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:33.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:33.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.316+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:22:33.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:33.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.337+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:33.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.353+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:22:33.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.374+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:22:33.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.380+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:33.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.410+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:33.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.415+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:22:33.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.432+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:22:33.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.436+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:22:33.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:22:33.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.454+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:22:33.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.472+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:22:33.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.488+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:22:33.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.492+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:22:33.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.510+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:22:33.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.528+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:22:33.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 177 15 2544522 2544507 898.379 898.688 0.000498069 0.00109859 2024-04-20T02:22:33.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.553+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:22:33.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.555+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:22:33.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.555+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:22:33.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.595+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:22:33.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.625+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:22:33.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.631+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:22:33.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.651+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:22:33.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.703+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:33.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.738+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:22:33.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:22:33.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.781+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:22:33.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.789+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:22:33.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.806+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:22:33.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.821+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:22:33.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.835+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:22:33.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:22:33.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.868+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:22:33.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.895+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:33.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.903+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:22:33.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.910+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:22:33.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.916+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:22:33.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.931+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:22:33.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.943+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:22:33.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.962+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:22:33.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.978+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:33.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.979+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:22:33.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:33.996+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:34.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.007+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:22:34.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.026+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:34.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.028+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:22:34.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.029+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:22:34.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:22:34.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:22:34.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.083+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:22:34.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.088+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:22:34.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.124+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:22:34.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.128+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:34.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.139+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:22:34.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.152+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:22:34.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.286+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:22:34.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.310+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:22:34.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.319+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:22:34.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.333+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:22:34.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.345+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:22:34.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.369+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:34.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.396+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:22:34.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.429+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:34.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.431+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:22:34.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.432+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:22:34.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.507+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:22:34.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 178 16 2557610 2557594 897.927 817.938 0.000744335 0.00109917 2024-04-20T02:22:34.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.559+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:22:34.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.565+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:22:34.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.577+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:22:34.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.596+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:22:34.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.603+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:22:34.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.636+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:22:34.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.659+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:22:34.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:22:34.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.681+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:22:34.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.711+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:22:34.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.721+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:34.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.747+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:34.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.753+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:22:34.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:22:34.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.780+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:22:34.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.801+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:22:34.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.804+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:34.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.816+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:22:34.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.838+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:22:34.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.847+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:34.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.861+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:22:34.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:22:34.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:34.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.889+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:22:34.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.895+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:22:34.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.911+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:22:34.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.927+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:22:34.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.974+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:22:34.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.976+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:22:34.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:34.992+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:22:35.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.008+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:22:35.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:35.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.036+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:22:35.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.039+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:22:35.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:22:35.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.133+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:22:35.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:22:35.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.167+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:22:35.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:22:35.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.204+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:22:35.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.252+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:22:35.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.262+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:22:35.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.282+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:22:35.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.308+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:22:35.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.332+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:22:35.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.348+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:35.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.373+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:35.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:22:35.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.389+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:22:35.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.392+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:22:35.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.444+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:22:35.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.463+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:22:35.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.468+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:22:35.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.484+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:22:35.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.489+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:22:35.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.507+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:22:35.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.529+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:22:35.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.533+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:22:35.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.538+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:22:35.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 179 16 2571744 2571728 897.845 883.375 0.00206947 0.00109926 2024-04-20T02:22:35.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.592+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:35.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.597+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:22:35.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.612+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:22:35.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.622+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:22:35.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.625+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:35.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.638+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:35.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.667+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:22:35.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.720+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:22:35.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.724+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:22:35.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.729+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:22:35.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.760+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:22:35.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.785+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:22:35.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.801+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:35.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.821+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:22:35.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:22:35.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.845+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:22:35.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.859+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:35.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.860+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:22:35.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.879+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:35.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.933+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:35.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.947+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:22:35.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.953+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:22:35.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:22:35.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:35.982+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:22:36.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.002+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:22:36.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.015+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:22:36.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.021+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:22:36.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.043+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:22:36.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.045+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:22:36.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.064+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:22:36.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.064+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:36.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.085+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:36.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.091+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:22:36.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.097+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:36.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.099+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:22:36.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.111+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:22:36.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:22:36.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.179+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:22:36.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.183+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:22:36.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.195+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:22:36.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.211+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:22:36.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:22:36.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.239+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:22:36.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.240+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:36.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.256+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:36.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.291+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:22:36.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.328+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:22:36.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.333+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:22:36.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.339+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:36.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.360+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:22:36.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.376+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:22:36.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.378+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:22:36.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.401+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:36.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.418+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:22:36.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.434+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:22:36.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.456+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:22:36.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.472+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:22:36.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.497+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:22:36.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.512+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:22:36.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.525+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:22:36.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.530+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:22:36.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.538+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:22:36.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:22:36.540774+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00109918 2024-04-20T02:22:36.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:22:36.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 180 16 2586315 2586299 897.916 910.688 0.00238401 0.00109918 2024-04-20T02:22:36.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.560+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:22:36.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.564+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:22:36.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.614+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:22:36.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:36.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.634+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:22:36.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.668+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:22:36.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:22:36.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.700+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:36.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.708+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:22:36.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.861+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:36.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.878+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:22:36.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.879+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:22:36.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.894+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:36.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.912+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:22:36.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.921+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:22:36.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.924+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:22:36.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:22:36.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.967+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:22:36.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:36.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:22:37.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.019+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:22:37.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.040+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:22:37.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.046+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:22:37.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.063+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:37.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.079+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:22:37.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.081+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:37.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.093+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:22:37.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:37.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.170+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:37.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.205+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:37.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.217+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:37.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.239+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:22:37.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.244+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:22:37.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.274+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:22:37.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.362+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:22:37.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.391+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:37.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:37.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.427+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:37.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:22:37.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.447+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:37.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.472+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:22:37.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.529+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:22:37.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 181 16 2599514 2599498 897.512 824.938 0.000634418 0.00109969 2024-04-20T02:22:37.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.554+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:22:37.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.574+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:22:37.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:37.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.598+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:22:37.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.609+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:22:37.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.633+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:22:37.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.647+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:22:37.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:22:37.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.694+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:22:37.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.709+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:22:37.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.733+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:37.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.751+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:22:37.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.772+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:22:37.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.809+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:22:37.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.827+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:22:37.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.852+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:22:37.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.855+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:22:37.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.862+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:22:37.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.878+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:22:37.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.895+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:22:37.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.936+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:22:37.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.937+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:22:37.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.939+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:22:37.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.978+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:22:37.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.980+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:22:37.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.988+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:22:37.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:37.992+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:22:38.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.012+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:22:38.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:22:38.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:22:38.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.056+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:22:38.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.078+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:38.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.080+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:38.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.086+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:22:38.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:38.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.134+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:38.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.134+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:38.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.160+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:22:38.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.169+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:22:38.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.209+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:22:38.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.230+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:22:38.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:22:38.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.271+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:22:38.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.303+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:22:38.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.338+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:22:38.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.364+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:22:38.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.374+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:22:38.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.446+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:22:38.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.460+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:22:38.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.505+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:38.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.520+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:22:38.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.524+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:38.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.533+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:22:38.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 182 16 2614315 2614299 897.663 925.062 0.001023 0.00109949 2024-04-20T02:22:38.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.556+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:38.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.559+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:38.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.561+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:22:38.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.619+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:22:38.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.662+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:22:38.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:22:38.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.697+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:22:38.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.711+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:22:38.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.715+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:22:38.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.717+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:22:38.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:38.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.763+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:22:38.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.782+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:38.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.821+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:22:38.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:22:38.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.856+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:22:38.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.858+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:22:38.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.902+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:22:38.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.930+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:22:38.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.937+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:38.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.961+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:22:38.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.980+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:38.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:38.983+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:39.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.033+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:22:39.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:22:39.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.057+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:22:39.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:22:39.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.114+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:22:39.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.116+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:22:39.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.126+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:22:39.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.132+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:22:39.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.141+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:39.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.188+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:22:39.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.206+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:22:39.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.234+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:22:39.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.256+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:39.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.258+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:22:39.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.283+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:39.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.319+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:39.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.329+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:22:39.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.350+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:22:39.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.355+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:22:39.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.405+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:39.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.427+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:22:39.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.429+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:22:39.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.448+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:39.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.448+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:22:39.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.493+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:22:39.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.532+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:22:39.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.538+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:22:39.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 183 16 2629169 2629153 897.831 928.375 0.000706128 0.00109929 2024-04-20T02:22:39.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.557+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:22:39.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.577+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:22:39.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.601+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:22:39.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.610+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:22:39.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.626+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:39.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.642+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:39.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.671+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:22:39.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.692+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:39.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.693+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:39.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.715+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:22:39.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.728+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:39.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.734+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:22:39.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.753+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:22:39.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:22:39.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.768+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:39.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.777+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:39.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:39.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.841+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:22:39.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.855+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:22:39.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.876+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:22:39.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:22:39.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.909+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:22:39.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.928+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:22:39.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.942+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:39.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.945+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:22:39.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.971+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:22:39.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:39.991+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:22:40.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.003+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:22:40.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.047+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:40.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.086+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:40.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:22:40.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.122+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:22:40.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.152+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:40.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.153+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:22:40.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.155+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:22:40.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.187+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:40.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.204+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:22:40.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.248+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:22:40.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.277+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:40.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.284+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:22:40.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:22:40.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.307+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:40.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.329+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:22:40.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.345+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:22:40.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.354+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:22:40.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.367+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:22:40.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.384+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:22:40.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.394+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:22:40.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.402+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:40.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.407+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:22:40.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.430+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:22:40.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:22:40.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:22:40.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.468+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:22:40.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.473+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:40.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:40.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.510+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:22:40.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.523+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:22:40.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 184 15 2643719 2643704 897.893 909.438 0.00134788 0.00109921 2024-04-20T02:22:40.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.541+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:40.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.553+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:22:40.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.556+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:22:40.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.575+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:22:40.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.592+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:22:40.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:22:40.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.625+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:22:40.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.640+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:22:40.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.644+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:22:40.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.645+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:22:40.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.686+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:22:40.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.703+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:22:40.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:40.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.722+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:40.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.735+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:40.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.739+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:40.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.742+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:22:40.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:22:40.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.769+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:40.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.781+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:40.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:22:40.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.802+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:22:40.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.803+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:40.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.879+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:22:40.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.959+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:22:40.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.978+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:22:40.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:40.983+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:22:41.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.011+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:22:41.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.026+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:22:41.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.029+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:22:41.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.042+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:41.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.051+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:22:41.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.063+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:22:41.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.079+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:22:41.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:22:41.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.119+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:22:41.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.128+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:41.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.131+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:22:41.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.172+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:22:41.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.178+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:22:41.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.195+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:22:41.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.199+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:22:41.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.214+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:22:41.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.226+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:22:41.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.246+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:22:41.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.273+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:22:41.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.289+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:22:41.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.314+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:22:41.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.332+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:22:41.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.346+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:41.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:22:41.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.372+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:22:41.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.424+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:22:41.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:41.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.450+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:22:41.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.473+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:22:41.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.492+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:22:41.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.497+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:22:41.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.506+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:41.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.533+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:22:41.539 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 185 15 2657638 2657623 897.742 869.938 0.00128909 0.0010994 2024-04-20T02:22:41.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.547+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:22:41.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.556+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:22:41.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:41.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:22:41.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.589+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:41.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.626+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:22:41.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.655+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:22:41.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.662+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:22:41.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.717+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:41.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.743+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:22:41.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.761+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:22:41.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.765+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:22:41.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.774+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:22:41.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.787+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:22:41.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.820+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:22:41.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:22:41.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.832+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:22:41.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.835+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:22:41.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.859+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:22:41.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.861+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:22:41.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.880+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:41.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.880+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:22:41.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:22:41.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.921+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:22:41.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.923+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:41.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.947+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:22:41.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.955+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:22:41.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:22:41.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.976+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:22:41.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.981+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:22:41.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.996+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:22:41.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:41.997+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:22:42.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.023+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:22:42.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.030+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:22:42.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.058+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:42.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:22:42.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.066+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:22:42.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.101+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:22:42.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.116+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:42.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.140+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:22:42.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.146+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:22:42.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.157+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:42.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.174+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:22:42.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.183+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:22:42.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.199+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:22:42.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.218+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:22:42.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.224+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:42.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.229+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:22:42.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.242+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:22:42.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.271+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:42.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.284+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:22:42.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.291+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:22:42.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.298+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:22:42.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.320+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:42.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.329+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:22:42.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.337+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:42.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.396+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:22:42.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:42.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.417+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:22:42.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.419+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:22:42.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.442+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:22:42.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.457+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:22:42.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.468+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:22:42.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.470+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:22:42.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:22:42.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:22:42.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.533+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:22:42.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 186 15 2671929 2671914 897.717 893.188 0.000802684 0.00109943 2024-04-20T02:22:42.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.595+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:42.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.614+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:22:42.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.653+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:22:42.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.669+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:22:42.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.671+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:22:42.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:22:42.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.728+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:42.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.732+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:22:42.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.747+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:22:42.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.792+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:22:42.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.795+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:42.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.825+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:22:42.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.832+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:22:42.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.840+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:42.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.887+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:22:42.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.902+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:22:42.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.911+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:22:42.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.933+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:22:42.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:42.996+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:43.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.019+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:22:43.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.029+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:22:43.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:22:43.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.064+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:22:43.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.085+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:22:43.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:22:43.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.098+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:22:43.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.130+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:22:43.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.175+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:43.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.181+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:43.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.205+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:22:43.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.218+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:22:43.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:22:43.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.272+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:22:43.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:43.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.300+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:43.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:22:43.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.320+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:22:43.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:22:43.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.342+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:22:43.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.354+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:22:43.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.372+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:22:43.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.394+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:43.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.395+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:22:43.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.415+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:43.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.434+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:22:43.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.443+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:22:43.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.483+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:22:43.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.503+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:43.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:43.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.539+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:43.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 187 16 2686862 2686846 897.907 933.25 0.00054784 0.0010992 2024-04-20T02:22:43.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.553+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:43.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.589+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:22:43.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:22:43.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.608+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:43.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.655+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:22:43.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.662+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:22:43.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:22:43.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.720+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:22:43.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.727+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:22:43.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.733+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:22:43.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.753+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:22:43.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:22:43.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.773+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:22:43.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.798+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:22:43.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.811+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:22:43.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.819+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:22:43.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.834+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:43.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.845+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:43.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.864+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:22:43.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.876+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:22:43.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.898+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:43.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.900+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:22:43.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.911+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:22:43.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.916+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:43.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.930+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:22:43.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.941+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:43.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.969+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:22:43.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.970+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:43.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:43.997+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:22:44.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.022+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:22:44.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.034+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:22:44.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.049+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:22:44.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.049+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:22:44.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.070+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:22:44.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.099+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:22:44.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.116+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:44.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.133+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:22:44.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:44.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.166+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:22:44.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:22:44.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.170+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:22:44.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.229+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:44.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:22:44.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:22:44.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.308+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:44.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.321+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:22:44.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:22:44.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:22:44.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.374+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:22:44.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:22:44.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.409+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:22:44.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.462+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:22:44.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.488+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:22:44.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:22:44.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.523+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:22:44.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.536+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:22:44.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 188 16 2701550 2701534 898.013 918 0.00160678 0.00109906 2024-04-20T02:22:44.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.557+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:44.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.570+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:22:44.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.579+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:44.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.597+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:22:44.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.604+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:22:44.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.611+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:22:44.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.642+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:44.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.645+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:22:44.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:22:44.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.663+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:22:44.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.667+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:22:44.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.680+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:22:44.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.702+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:44.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.726+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:22:44.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.780+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:22:44.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.792+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:22:44.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.821+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:22:44.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:22:44.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.856+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:22:44.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.870+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:22:44.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:22:44.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.895+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:44.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.918+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:22:44.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.930+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:44.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.959+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:22:44.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.993+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:22:44.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:44.994+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:45.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.012+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:22:45.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.034+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:22:45.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.067+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:22:45.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.079+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:22:45.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.081+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:22:45.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.114+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:22:45.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.119+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:22:45.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.139+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:22:45.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.158+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:45.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.159+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:22:45.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.195+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:22:45.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.198+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:22:45.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.200+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:45.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.234+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:22:45.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.235+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:22:45.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.252+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:45.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:22:45.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.369+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:22:45.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.384+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:22:45.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.398+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:22:45.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.429+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:22:45.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.433+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:22:45.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.440+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:45.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.480+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:22:45.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.508+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:22:45.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.528+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:22:45.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.539+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:45.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 189 16 2716406 2716390 898.174 928.5 0.001101 0.00109886 2024-04-20T02:22:45.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.545+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:22:45.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.561+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:45.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.580+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:22:45.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.606+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:22:45.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.622+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:22:45.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.638+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:22:45.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.647+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:22:45.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.649+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:22:45.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:22:45.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.693+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:22:45.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.718+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:22:45.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.726+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:22:45.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:22:45.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.761+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:22:45.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.772+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:22:45.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.782+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:45.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:22:45.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.813+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:22:45.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.827+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:22:45.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.829+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:22:45.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:22:45.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.858+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:22:45.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.876+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:22:45.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.879+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:45.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.895+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:22:45.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.902+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:22:45.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.979+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:22:45.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:45.987+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:22:46.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.021+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:22:46.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.045+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:22:46.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.091+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:22:46.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.102+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:22:46.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.107+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:22:46.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.128+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:22:46.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.134+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:22:46.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.141+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:22:46.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.151+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:22:46.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.159+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:46.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.170+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:22:46.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.185+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:22:46.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.208+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:22:46.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.214+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:22:46.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.243+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:22:46.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.253+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:22:46.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.257+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:22:46.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.282+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:22:46.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.294+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:22:46.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.296+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:22:46.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.317+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:22:46.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.335+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:46.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.340+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:46.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:22:46.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.403+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:22:46.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.424+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:22:46.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.431+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:22:46.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:46.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:46.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:22:46.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.482+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:22:46.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 190 16 2730416 2730400 898.054 875.625 0.000883783 0.00109901 2024-04-20T02:22:46.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.561+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:46.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.597+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:22:46.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.619+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:22:46.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:22:46.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.641+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:22:46.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:22:46.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.679+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:46.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.704+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:22:46.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.704+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:22:46.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:22:46.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.781+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:22:46.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.799+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:22:46.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:22:46.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.886+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:22:46.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:22:46.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:22:46.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:46.987+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:22:47.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.003+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:22:47.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.008+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:22:47.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.030+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:22:47.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.037+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:22:47.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.049+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:22:47.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.060+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:22:47.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.062+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:22:47.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:47.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.083+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:22:47.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.109+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:47.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.223+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:47.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.230+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:22:47.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.261+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:22:47.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.265+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:47.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.286+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:22:47.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.294+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:22:47.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.315+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:22:47.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.320+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:22:47.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.337+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:22:47.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.361+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:22:47.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:22:47.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.380+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:47.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.397+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:47.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.423+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:22:47.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.437+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:22:47.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:22:47.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.463+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:22:47.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.464+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:22:47.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.484+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:22:47.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.485+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:22:47.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.500+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:22:47.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.527+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:22:47.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 191 16 2743841 2743825 897.745 839.062 0.000988792 0.00109939 2024-04-20T02:22:47.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.554+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:22:47.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.561+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:22:47.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.568+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:22:47.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.646+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:22:47.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.657+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:22:47.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.660+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:22:47.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.679+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:22:47.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:22:47.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:22:47.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.719+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:22:47.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.766+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:22:47.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.785+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:22:47.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.838+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:22:47.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.859+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:22:47.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.879+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:22:47.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.882+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:22:47.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.883+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:22:47.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.901+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:22:47.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.908+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:22:47.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:22:47.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.960+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:22:47.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.963+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:22:47.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:47.983+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:22:48.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.000+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:22:48.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.010+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:48.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.014+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:48.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.042+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:22:48.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.050+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:22:48.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.058+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:22:48.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.066+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:22:48.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.073+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:22:48.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.110+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:48.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.129+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:22:48.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.135+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:22:48.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.145+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:22:48.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.151+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:22:48.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.166+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:22:48.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.181+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:22:48.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.185+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:22:48.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.234+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:22:48.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.240+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:22:48.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.249+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:22:48.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.283+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:22:48.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.288+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:22:48.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.340+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:22:48.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.358+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:22:48.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.370+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:22:48.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.372+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:22:48.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.392+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:22:48.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.403+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:48.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.416+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:22:48.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.444+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:22:48.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.453+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:22:48.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.485+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:22:48.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.490+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:22:48.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.495+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:22:48.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.527+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:22:48.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 192 16 2758478 2758462 897.834 914.812 0.00260772 0.00109928 2024-04-20T02:22:48.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.549+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:22:48.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.582+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:22:48.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.602+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:22:48.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.620+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:22:48.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.626+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:22:48.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.649+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:48.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.655+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:22:48.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.674+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:48.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.696+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:22:48.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.699+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:22:48.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:22:48.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.753+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:22:48.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.757+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:22:48.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.757+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:22:48.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.789+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:48.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:22:48.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.805+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:48.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.817+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:48.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.835+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:22:48.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.863+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:22:48.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.872+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:22:48.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:22:48.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.927+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:22:48.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.944+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:22:48.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.963+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:22:48.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:48.988+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:49.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.024+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:22:49.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.041+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:49.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:22:49.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:22:49.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.082+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:22:49.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.084+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:22:49.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.103+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:22:49.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.131+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:22:49.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.144+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:22:49.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:22:49.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.192+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:22:49.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.211+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:22:49.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.214+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:22:49.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.222+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:22:49.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.271+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:22:49.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.275+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:49.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.286+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:22:49.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.292+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:22:49.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.301+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:22:49.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.331+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:49.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:22:49.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.346+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:49.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.353+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:22:49.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.371+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:49.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:22:49.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.394+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:49.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.394+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:49.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.460+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:22:49.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.464+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:22:49.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.473+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:49.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.482+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:22:49.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.485+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:22:49.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.503+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:22:49.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.516+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:22:49.540 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 193 16 2773109 2773093 897.919 914.438 0.001184 0.00109917 2024-04-20T02:22:49.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.542+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:22:49.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.565+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:22:49.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.586+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:22:49.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.603+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:49.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.608+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:22:49.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.611+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:22:49.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.634+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:22:49.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.652+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:49.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.660+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:22:49.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.675+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:22:49.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.677+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:22:49.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.681+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:22:49.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.691+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:22:49.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.713+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:22:49.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.736+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:22:49.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.739+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:22:49.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.795+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:49.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.823+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:49.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:22:49.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:22:49.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.861+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:22:49.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.865+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:22:49.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.874+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:22:49.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.893+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:22:49.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.980+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:49.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:49.997+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:22:50.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.037+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:22:50.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:22:50.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.064+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:22:50.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.074+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:22:50.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.081+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:22:50.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:50.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.104+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:22:50.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.122+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:50.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.141+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:22:50.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:22:50.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.204+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:22:50.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.220+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:50.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.231+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:22:50.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.239+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:22:50.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.252+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:22:50.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.259+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:50.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.287+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:50.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.361+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:22:50.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.362+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:50.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:22:50.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.380+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:22:50.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.413+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:22:50.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.430+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:22:50.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:22:50.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.456+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:22:50.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.469+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:22:50.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.471+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:22:50.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.493+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:50.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:22:50.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 194 16 2787487 2787471 897.923 898.625 0.00046046 0.00109904 2024-04-20T02:22:50.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.581+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:22:50.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.585+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:22:50.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:22:50.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.618+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:50.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.640+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:50.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:50.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.671+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:50.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.676+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:22:50.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.683+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:50.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:22:50.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.722+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:22:50.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.725+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:22:50.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.761+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:22:50.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:50.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.804+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:22:50.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.808+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:22:50.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.820+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:22:50.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.834+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:22:50.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.843+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:22:50.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:22:50.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.886+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:50.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.909+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:50.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.911+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:22:50.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.924+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:22:50.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.941+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:22:50.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.945+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:22:50.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.974+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:22:50.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.974+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:22:50.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:50.981+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:51.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:22:51.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.009+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:22:51.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:51.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.040+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:22:51.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.050+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:51.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.065+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:22:51.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.088+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:51.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.100+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:22:51.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.145+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:22:51.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.199+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:51.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.212+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:22:51.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.217+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:22:51.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:51.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.261+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:22:51.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.269+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:22:51.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.288+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:51.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.302+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:22:51.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.317+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:22:51.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.335+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:22:51.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.377+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:22:51.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.403+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:22:51.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.413+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:22:51.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.434+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:51.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.434+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:51.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.452+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:22:51.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.472+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:51.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.484+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:22:51.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.501+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:22:51.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 195 16 2801630 2801614 897.85 883.938 0.00108173 0.00109926 2024-04-20T02:22:51.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.541+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:22:51.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.582+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:22:51.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.588+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:22:51.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.595+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:22:51.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.623+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:51.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.653+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:51.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.657+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:22:51.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.660+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:22:51.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.680+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:22:51.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.696+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:22:51.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.713+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:22:51.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.726+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:51.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.732+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:22:51.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.757+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:22:51.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.786+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:22:51.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.789+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:22:51.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.809+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:22:51.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.829+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:22:51.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.851+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:22:51.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.857+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:22:51.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.862+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:51.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.894+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:22:51.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:22:51.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:51.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.931+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:22:51.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.947+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:22:51.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.953+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:51.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:22:51.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:51.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:51.989+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:22:52.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.006+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:22:52.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.012+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:22:52.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.035+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:22:52.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:22:52.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.058+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:52.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.073+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:22:52.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:22:52.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.116+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:52.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.131+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:52.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.144+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:52.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.161+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:22:52.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.166+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:52.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.175+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:22:52.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.206+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:22:52.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.213+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:52.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:22:52.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.236+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:22:52.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:22:52.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:22:52.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.288+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:22:52.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.294+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:22:52.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.319+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:22:52.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.336+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:22:52.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.388+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:22:52.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.392+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:22:52.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.395+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:22:52.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.412+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:22:52.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.422+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:22:52.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:22:52.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.468+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:52.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.472+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:52.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.472+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:22:52.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.505+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:22:52.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.526+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:22:52.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 196 16 2815829 2815813 897.797 887.438 0.00234754 0.00109932 2024-04-20T02:22:52.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.558+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:22:52.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.583+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:22:52.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.593+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:52.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.614+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:22:52.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.660+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:22:52.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.668+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:52.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.690+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:22:52.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.710+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:22:52.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.711+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:22:52.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.737+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:52.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.750+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:22:52.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.765+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:22:52.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:22:52.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.799+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:22:52.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.800+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:22:52.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.843+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:22:52.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.865+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:22:52.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:22:52.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.913+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:22:52.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:22:52.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.948+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:22:52.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:22:52.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:52.993+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:22:53.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.008+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:22:53.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.026+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:22:53.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.032+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:22:53.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:22:53.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.091+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:22:53.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.094+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:53.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.106+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:22:53.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:22:53.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.132+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:22:53.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:22:53.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.165+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:53.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.184+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:22:53.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.186+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:53.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.208+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:22:53.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.232+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:22:53.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.257+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:22:53.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.273+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:22:53.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.296+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:22:53.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.310+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:22:53.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.326+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:53.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.352+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:22:53.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.402+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:22:53.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.431+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:22:53.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:22:53.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.483+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:22:53.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:22:53.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.516+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:53.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:22:53.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:22:53.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 197 16 2830433 2830417 897.872 912.75 0.000927484 0.00109923 2024-04-20T02:22:53.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.548+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:22:53.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.580+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:22:53.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.591+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:22:53.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:22:53.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.614+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:22:53.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.641+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:22:53.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:22:53.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.726+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:53.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.727+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:22:53.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.756+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:22:53.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.789+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:22:53.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.806+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:22:53.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.812+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:22:53.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.825+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:22:53.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.841+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:22:53.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:22:53.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.862+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:53.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.882+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:22:53.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:22:53.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.906+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:22:53.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:22:53.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:53.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.934+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:22:53.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.956+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:22:53.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.987+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:22:53.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:53.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:22:54.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.010+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:22:54.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.019+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:22:54.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.051+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:22:54.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.051+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:22:54.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:22:54.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.082+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:22:54.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:22:54.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.172+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:22:54.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.185+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:22:54.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.188+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:22:54.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.191+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:22:54.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.208+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:22:54.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.217+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:22:54.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:22:54.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.260+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:22:54.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.274+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:22:54.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.279+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:54.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.300+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:22:54.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.322+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:22:54.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.325+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:22:54.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:22:54.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.371+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:22:54.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.395+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:22:54.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.410+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:22:54.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.412+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:22:54.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.421+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:22:54.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.435+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:22:54.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.465+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:22:54.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:54.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.480+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:22:54.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.494+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:22:54.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.499+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:54.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.525+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:22:54.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.528+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:22:54.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 198 16 2844312 2844296 897.718 867.438 0.000788562 0.00109942 2024-04-20T02:22:54.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.543+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:22:54.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.546+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:22:54.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.579+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:22:54.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.594+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:22:54.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.617+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:54.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.637+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:22:54.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.641+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:22:54.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.656+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:22:54.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.666+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:22:54.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.691+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:22:54.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.704+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:22:54.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.706+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:54.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.725+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:22:54.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:22:54.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.752+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:22:54.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.781+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:22:54.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:22:54.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.805+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:22:54.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.824+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:22:54.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.837+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:22:54.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.876+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:22:54.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.885+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:54.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.896+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:22:54.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.900+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:22:54.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.919+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:54.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.946+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:22:54.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.965+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:22:54.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.988+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:22:54.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:54.991+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:22:55.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.002+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:22:55.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.028+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:22:55.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.040+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:22:55.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.061+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:55.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:22:55.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.134+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:22:55.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.136+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:22:55.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.152+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:55.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.163+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:22:55.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.175+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:22:55.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.198+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:22:55.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.231+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:22:55.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.233+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:22:55.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.235+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:22:55.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.268+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:22:55.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.277+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:22:55.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.298+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:22:55.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.302+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:22:55.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.316+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:22:55.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:22:55.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.344+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:22:55.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.349+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:22:55.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:22:55.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.376+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:22:55.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.390+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:22:55.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.403+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:22:55.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.412+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:22:55.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:22:55.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.455+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:22:55.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.473+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:22:55.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:22:55.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.487+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:22:55.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.509+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:22:55.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.511+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:22:55.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.523+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:22:55.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:22:55.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 199 16 2858800 2858784 897.756 905.5 0.000718776 0.00109938 2024-04-20T02:22:55.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.577+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:55.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.604+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:22:55.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.617+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:22:55.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.624+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:22:55.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.640+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:22:55.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.655+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:55.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:22:55.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.677+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:22:55.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.698+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:22:55.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.700+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:22:55.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.736+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:22:55.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.752+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:22:55.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.753+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:22:55.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.789+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:22:55.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.792+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:22:55.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.818+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:22:55.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.819+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:22:55.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.842+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:22:55.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.850+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:22:55.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.869+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:22:55.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:22:55.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.919+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:22:55.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.921+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:22:55.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.939+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:22:55.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.958+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:55.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.981+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:22:55.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:55.982+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:22:56.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.000+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:22:56.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.020+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:22:56.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:22:56.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.069+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:22:56.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.070+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:22:56.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.086+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:22:56.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.097+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:22:56.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.102+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:22:56.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.107+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:22:56.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.152+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:22:56.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.164+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:22:56.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.184+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:22:56.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.219+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:56.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.263+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:22:56.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.305+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:22:56.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.313+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:22:56.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.376+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:22:56.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.379+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:22:56.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.391+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:22:56.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.405+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:22:56.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.447+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:56.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:22:56.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.495+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:22:56.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.506+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:56.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:22:56.542693+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00109917 2024-04-20T02:22:56.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:22:56.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 200 16 2873726 2873710 897.932 932.875 0.000621759 0.00109917 2024-04-20T02:22:56.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.541+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:22:56.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.542+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:22:56.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.544+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:22:56.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:22:56.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.578+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:56.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.606+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:22:56.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.612+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:22:56.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.629+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:22:56.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.630+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:22:56.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.631+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:22:56.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.656+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:22:56.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.664+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:22:56.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.685+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:22:56.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.688+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:56.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:22:56.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.727+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:22:56.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.743+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:56.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.756+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:22:56.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.761+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:22:56.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.784+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:22:56.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.799+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:22:56.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.806+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:22:56.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:22:56.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.881+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:22:56.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.888+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:22:56.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.899+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:22:56.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.906+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:22:56.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.923+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:22:56.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.929+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:22:56.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.957+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:22:56.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.964+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:22:56.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:56.968+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:22:57.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.011+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:22:57.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.062+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:22:57.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.075+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:22:57.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.076+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:57.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.092+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:22:57.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.108+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:57.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.130+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:22:57.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.145+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:22:57.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.151+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:57.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.169+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:22:57.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.180+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:22:57.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.214+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:22:57.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.236+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:22:57.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.240+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:22:57.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.258+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:22:57.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.277+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:22:57.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.290+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:22:57.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.307+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:22:57.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.307+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:22:57.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.320+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:22:57.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.321+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:22:57.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.331+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:22:57.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:22:57.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.355+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:22:57.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.371+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:22:57.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.383+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:22:57.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.405+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:22:57.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.406+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:22:57.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.434+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:22:57.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:22:57.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.443+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:22:57.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.460+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:22:57.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.486+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:22:57.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.517+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:22:57.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.541+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:22:57.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 201 16 2888031 2888015 897.911 894.062 0.000561337 0.0010992 2024-04-20T02:22:57.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.556+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:22:57.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.557+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:22:57.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.584+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:22:57.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.615+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:22:57.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.632+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:22:57.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:22:57.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.656+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:22:57.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.666+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:22:57.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.704+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:22:57.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.706+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:22:57.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.712+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:22:57.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.729+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:22:57.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.755+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:22:57.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.759+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:57.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.781+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:22:57.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:22:57.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.813+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:22:57.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.818+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:22:57.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:22:57.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.854+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:22:57.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.878+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:22:57.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.899+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:22:57.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.925+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:22:57.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.945+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:22:57.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.949+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:22:57.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.970+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:22:57.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:57.988+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:22:58.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.002+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:22:58.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.009+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:22:58.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:22:58.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.036+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:22:58.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.053+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:22:58.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.069+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:22:58.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.071+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:22:58.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.074+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:22:58.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.090+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:22:58.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:22:58.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:22:58.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.136+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:22:58.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.157+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:22:58.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.161+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:22:58.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.177+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:22:58.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:22:58.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.231+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:22:58.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:22:58.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.241+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:22:58.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.275+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:22:58.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.281+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:22:58.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.299+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:22:58.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.322+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:22:58.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.336+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:22:58.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.340+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:22:58.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.353+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:58.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.366+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:58.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.384+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:22:58.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.385+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:22:58.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.418+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:22:58.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.440+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:22:58.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.446+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:22:58.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.457+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:22:58.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.491+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:22:58.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.492+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:22:58.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.517+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:22:58.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.520+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:22:58.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.531+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:22:58.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.532+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:22:58.541 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 202 16 2902634 2902618 897.984 912.688 0.000748329 0.0010991 2024-04-20T02:22:58.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.555+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:22:58.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.574+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:22:58.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.589+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:22:58.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.606+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:22:58.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.626+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:22:58.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:22:58.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.642+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:22:58.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.657+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:22:58.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.676+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:22:58.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:22:58.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:22:58.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:22:58.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.718+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:22:58.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.742+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:22:58.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.752+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:22:58.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:22:58.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.835+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:22:58.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.846+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:22:58.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.876+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:22:58.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.885+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:22:58.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:22:58.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.956+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:22:58.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.969+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:22:58.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.973+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:22:58.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:58.996+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:22:59.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.004+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:22:59.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.031+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:22:59.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.056+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:22:59.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.059+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:59.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:22:59.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.099+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:22:59.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.130+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:22:59.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:22:59.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.144+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:22:59.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:22:59.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.187+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:22:59.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.235+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:22:59.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.281+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:22:59.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.283+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:22:59.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.300+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:22:59.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.325+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:22:59.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.328+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:59.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.349+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:22:59.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.382+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:22:59.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.399+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:22:59.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.407+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:22:59.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.424+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:22:59.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.430+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:22:59.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.441+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:22:59.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.450+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:22:59.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.478+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:22:59.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.515+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:22:59.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.518+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:22:59.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 203 15 2917531 2917516 898.146 931.125 0.000945688 0.0010989 2024-04-20T02:22:59.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.546+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:22:59.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.577+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:22:59.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.592+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:22:59.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.600+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:22:59.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.644+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:22:59.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.668+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:22:59.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.673+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:22:59.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:22:59.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.721+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:22:59.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.730+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:22:59.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:22:59.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.745+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:22:59.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.770+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:22:59.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.805+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:22:59.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.818+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:22:59.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.824+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:22:59.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.826+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:22:59.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.867+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:22:59.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.890+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:22:59.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.895+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:22:59.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.919+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:22:59.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.920+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:22:59.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.932+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:22:59.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.936+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:22:59.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.957+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:22:59.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:22:59.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:22:59.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:23:00.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.027+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:23:00.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.068+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:23:00.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.111+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:23:00.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.112+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:23:00.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:23:00.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:23:00.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.164+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:23:00.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.203+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:23:00.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.211+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:00.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.212+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:23:00.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.238+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:23:00.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:23:00.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.251+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:23:00.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.272+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:23:00.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.279+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:23:00.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.280+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:00.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.291+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:23:00.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.308+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:23:00.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.335+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:00.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.348+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:23:00.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.363+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:23:00.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:23:00.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.400+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:23:00.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.438+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:23:00.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.450+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:00.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.457+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:00.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.490+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:00.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.491+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:23:00.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.520+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:23:00.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.534+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:00.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 204 16 2932192 2932176 898.235 916.25 0.00126131 0.00109879 2024-04-20T02:23:00.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.543+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:23:00.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.550+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:23:00.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.557+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:23:00.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.576+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:23:00.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.604+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:23:00.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.619+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:23:00.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.631+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:23:00.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:00.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.653+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:23:00.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.678+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:23:00.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.682+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:23:00.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.710+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:23:00.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.717+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:23:00.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.735+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:23:00.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.748+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:23:00.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.774+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:00.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.778+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:00.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.787+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:23:00.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.796+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:23:00.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.815+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:23:00.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.834+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:00.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:00.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.856+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:00.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.923+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:23:00.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:23:00.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.969+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:23:00.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:00.991+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:23:01.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:23:01.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.055+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:23:01.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:23:01.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:23:01.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.154+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:01.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.177+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:01.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.192+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:23:01.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.198+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:23:01.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.211+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:23:01.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.220+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:23:01.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.236+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:23:01.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.237+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:23:01.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.268+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:23:01.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.274+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:01.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.289+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:01.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:01.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.320+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:23:01.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.350+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:01.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:23:01.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.366+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:23:01.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.388+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:01.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.402+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:23:01.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.404+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:23:01.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.426+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:23:01.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.435+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:23:01.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.443+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:23:01.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.479+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:23:01.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.508+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:23:01.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.523+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:23:01.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 205 16 2946651 2946635 898.261 903.688 0.000600558 0.00109876 2024-04-20T02:23:01.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.550+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:23:01.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.578+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:23:01.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.597+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:01.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.622+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:23:01.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.624+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:23:01.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.647+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:01.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:23:01.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.670+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:23:01.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.691+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:01.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.706+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:23:01.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:01.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.731+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:23:01.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:01.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.768+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:23:01.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:01.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.814+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:01.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.822+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:23:01.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.829+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:23:01.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.853+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:01.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.864+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:23:01.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.874+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:01.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.969+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:23:01.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.976+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:01.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.976+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:01.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:01.999+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:23:02.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.021+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:02.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.025+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:23:02.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.050+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:02.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.067+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:23:02.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.080+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:23:02.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.089+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:23:02.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.099+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:23:02.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.123+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:23:02.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.142+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:23:02.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.158+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:23:02.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.159+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:02.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.179+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:23:02.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.192+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:23:02.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.196+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:23:02.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.221+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:23:02.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.237+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:02.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.245+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:02.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.270+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:23:02.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.308+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:02.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.314+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:23:02.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.316+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:02.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:23:02.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.366+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:23:02.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.389+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:23:02.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.420+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:02.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.430+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:23:02.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:23:02.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.467+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:23:02.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.480+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:02.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.484+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:02.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.513+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:02.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.515+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:02.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 206 16 2960001 2959985 897.95 834.375 0.00065344 0.00109915 2024-04-20T02:23:02.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.566+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:02.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.591+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:23:02.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:02.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.636+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:23:02.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.652+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:23:02.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.654+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:23:02.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.667+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:23:02.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.692+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:23:02.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.716+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:02.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.727+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:23:02.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:23:02.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.757+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:23:02.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.768+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:23:02.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.790+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:23:02.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.828+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:02.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.839+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:23:02.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.858+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:02.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.861+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:02.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:23:02.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.872+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:23:02.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.918+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:02.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.926+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:23:02.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.931+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:23:02.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.968+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:23:02.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.982+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:23:02.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:02.993+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:23:03.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.007+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:03.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.011+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:23:03.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.012+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:23:03.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.037+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:03.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.053+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:23:03.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.073+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:23:03.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.089+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:03.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.090+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:03.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.121+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:03.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.153+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:23:03.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.159+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:03.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.170+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:23:03.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.200+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:23:03.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.241+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:23:03.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.265+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:23:03.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.280+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:03.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:03.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.311+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:03.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.322+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:23:03.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.344+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:03.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.364+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:23:03.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.376+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:23:03.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:23:03.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:23:03.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.446+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:23:03.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.458+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:23:03.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.470+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:23:03.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.481+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:23:03.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.485+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:23:03.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.495+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:23:03.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.500+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:23:03.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.521+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:23:03.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 207 15 2974679 2974664 898.044 917.438 0.00091312 0.00109903 2024-04-20T02:23:03.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.557+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:23:03.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.592+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:23:03.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.604+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:23:03.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.632+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:03.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.641+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:23:03.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.663+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:03.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.664+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:23:03.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.672+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:23:03.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:23:03.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.718+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:23:03.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.723+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:23:03.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.745+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:03.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.746+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:03.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.771+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:03.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.783+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:23:03.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.798+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:23:03.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.801+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:23:03.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.828+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:23:03.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.840+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:03.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.859+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:23:03.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.863+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:03.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.882+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:23:03.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.930+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:23:03.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.952+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:23:03.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.981+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:23:03.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:03.986+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:04.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:23:04.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.025+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:23:04.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.028+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:04.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:23:04.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.053+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:04.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.069+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:04.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:23:04.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.101+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:23:04.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.113+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:23:04.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.125+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:04.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.125+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:23:04.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.158+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:23:04.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.160+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:23:04.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.170+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:23:04.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.210+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:23:04.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.227+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:04.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.233+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:04.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.249+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:23:04.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.259+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:04.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.259+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:23:04.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.271+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:04.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.302+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:23:04.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.321+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:23:04.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:23:04.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.403+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:04.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.410+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:23:04.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.427+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:23:04.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.457+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:23:04.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.463+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:04.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.464+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:23:04.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.491+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:23:04.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:23:04.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.515+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:23:04.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.519+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:23:04.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.526+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:04.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 208 15 2989227 2989212 898.097 909.25 0.000632071 0.00109896 2024-04-20T02:23:04.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.553+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:04.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.560+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:23:04.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.577+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:23:04.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:23:04.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.625+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:23:04.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:04.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.664+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:23:04.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:23:04.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.680+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:23:04.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.708+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:23:04.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.720+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:04.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.734+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:04.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:23:04.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.761+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:04.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.766+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:23:04.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.817+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:23:04.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.819+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:04.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.863+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:23:04.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.888+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:23:04.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.896+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:04.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.904+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:23:04.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.909+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:04.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.923+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:04.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.949+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:23:04.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.955+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:04.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:04.989+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:23:05.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.020+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:23:05.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.044+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:23:05.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.059+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:05.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.077+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:05.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.082+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:23:05.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.128+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:05.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:23:05.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.178+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:23:05.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.198+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:23:05.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.213+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:23:05.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:23:05.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.237+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:23:05.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.247+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:23:05.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.266+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:23:05.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.307+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:05.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.320+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:23:05.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.321+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:23:05.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.331+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:23:05.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.356+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:23:05.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.369+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:23:05.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.371+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:23:05.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.386+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:23:05.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.406+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:05.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.408+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:23:05.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.426+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:05.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.447+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:23:05.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:23:05.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.484+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:23:05.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.496+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:23:05.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.513+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:23:05.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.514+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:23:05.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.515+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:23:05.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:05.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 209 15 3003798 3003783 898.157 910.688 0.000643876 0.00109888 2024-04-20T02:23:05.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.547+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:23:05.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.588+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:23:05.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.588+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:23:05.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:05.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:23:05.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:23:05.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.669+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:05.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.670+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:23:05.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.689+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:23:05.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.709+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:23:05.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:23:05.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:23:05.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.752+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:05.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.761+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:23:05.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:23:05.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.784+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:23:05.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.789+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:23:05.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.814+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:23:05.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.829+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:23:05.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.867+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:23:05.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.904+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:23:05.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.907+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:23:05.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.921+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:05.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.928+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:23:05.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:05.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:23:06.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.038+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:06.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.066+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:23:06.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.072+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:23:06.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.091+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:06.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.109+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:06.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.134+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:06.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.151+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:23:06.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.178+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:23:06.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.190+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:06.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:23:06.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.269+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:23:06.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.297+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:23:06.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.315+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:23:06.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.341+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:23:06.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.348+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:06.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.385+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:23:06.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.410+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:23:06.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:23:06.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:06.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.443+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:23:06.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.460+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:23:06.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.489+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:23:06.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.494+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:23:06.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.523+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:23:06.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.528+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:23:06.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 210 16 3017536 3017520 897.968 858.562 0.00204084 0.00109913 2024-04-20T02:23:06.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.546+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:23:06.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.552+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:23:06.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.582+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:23:06.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.595+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:06.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.636+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:06.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:23:06.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.662+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:23:06.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:06.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.686+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:06.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.710+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:23:06.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:23:06.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.717+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:23:06.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.727+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:23:06.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.741+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:23:06.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:06.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.763+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:06.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.764+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:06.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.810+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:23:06.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.815+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:06.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.839+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:06.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.858+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:23:06.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.869+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:23:06.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:06.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.912+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:23:06.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.912+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:06.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.927+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:06.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.972+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:23:06.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:06.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:23:07.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.008+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:23:07.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.024+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:23:07.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.055+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:23:07.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.081+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:23:07.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:23:07.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.106+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:23:07.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.111+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:23:07.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.138+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:23:07.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.173+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:23:07.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.184+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:23:07.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.194+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:23:07.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.207+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:07.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.223+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:23:07.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.237+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:07.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.255+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:23:07.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.263+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:07.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:23:07.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.297+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:23:07.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.304+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:23:07.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.311+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:07.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.333+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:23:07.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.349+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:07.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.367+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:23:07.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.385+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:23:07.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.409+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:07.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.419+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:23:07.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.430+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:23:07.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.451+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:23:07.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.508+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:07.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.523+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:07.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.532+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:23:07.542 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 211 16 3031685 3031669 897.903 884.312 0.0013095 0.0010992 2024-04-20T02:23:07.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.548+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:23:07.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.555+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:23:07.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:23:07.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.598+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:23:07.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.612+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:23:07.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.618+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:23:07.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.636+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:07.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.659+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:23:07.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.679+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:07.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.697+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:23:07.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.698+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:23:07.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.727+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:23:07.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.731+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:07.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.747+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:07.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.761+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:23:07.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:23:07.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.788+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:23:07.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.830+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:07.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.846+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:23:07.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.852+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:23:07.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.873+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:23:07.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.879+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:23:07.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.900+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:23:07.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.911+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:23:07.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.923+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:23:07.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.936+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:23:07.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.936+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:23:07.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.956+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:07.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:07.976+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:23:08.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:23:08.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.050+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:08.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.061+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:08.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.075+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:23:08.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.084+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:23:08.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.085+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:23:08.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.104+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:08.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.126+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:23:08.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:23:08.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.133+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:23:08.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.147+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:23:08.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.154+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:23:08.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.178+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:23:08.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.195+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:08.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:08.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.265+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:23:08.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.294+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:23:08.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.307+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:23:08.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.328+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:23:08.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.350+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:23:08.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.366+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:23:08.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.367+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:23:08.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.390+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:08.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.392+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:23:08.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.409+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:08.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.416+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:23:08.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.443+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:23:08.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.460+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:23:08.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.463+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:08.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.470+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:23:08.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.489+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:23:08.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 212 16 3046281 3046265 897.97 912.25 0.000574504 0.00109912 2024-04-20T02:23:08.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.551+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:23:08.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.557+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:08.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.585+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:23:08.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.587+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:23:08.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:23:08.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.618+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:23:08.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:23:08.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.648+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:23:08.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.687+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:23:08.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.696+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:23:08.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.714+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:23:08.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.720+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:23:08.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.735+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:23:08.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:08.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.746+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:08.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:23:08.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.781+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:23:08.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.795+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:23:08.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:23:08.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.839+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:23:08.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.863+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:23:08.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.879+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:23:08.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.884+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:23:08.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.900+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:08.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.905+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:23:08.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.917+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:23:08.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.930+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:23:08.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.932+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:23:08.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.960+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:23:08.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.960+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:23:08.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:08.994+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:23:09.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.014+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:23:09.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.035+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:23:09.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.041+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:23:09.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.088+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:09.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.106+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:09.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.147+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:23:09.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.147+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:23:09.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.149+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:23:09.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.175+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:23:09.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.209+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:23:09.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.227+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:09.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:23:09.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.266+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:23:09.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.273+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:23:09.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.275+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:23:09.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.321+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:23:09.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.325+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:23:09.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.350+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:23:09.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.372+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:09.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.377+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:23:09.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.413+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:09.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.417+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:09.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.437+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:09.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.442+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:23:09.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.474+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:23:09.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.487+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:23:09.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.542+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:23:09.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 213 16 3060796 3060780 898.012 907.188 0.00093231 0.00109907 2024-04-20T02:23:09.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.551+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:09.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:09.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.584+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:23:09.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.587+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:23:09.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.605+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:23:09.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.626+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:09.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.638+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:23:09.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.653+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:23:09.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.681+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:23:09.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.691+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:09.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.703+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:09.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.770+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:23:09.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:23:09.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.791+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:23:09.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.804+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:23:09.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.878+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:23:09.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.886+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:09.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.897+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:23:09.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:23:09.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.930+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:23:09.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.950+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:23:09.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:09.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:09.980+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:23:10.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:10.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.036+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:23:10.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:23:10.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.068+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:10.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.078+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:23:10.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.082+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:23:10.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.108+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:23:10.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.123+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:23:10.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.128+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:23:10.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.163+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:23:10.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.214+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:23:10.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:10.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.253+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:23:10.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.256+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:23:10.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.261+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:10.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.276+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:10.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.281+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:10.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.294+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:10.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.304+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:23:10.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.320+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:23:10.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.335+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:23:10.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:23:10.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.364+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:23:10.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.370+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:23:10.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.415+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:23:10.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:23:10.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.476+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:10.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.492+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:23:10.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.496+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:23:10.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:23:10.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.522+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:10.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 214 16 3074285 3074269 897.755 843.062 0.00098913 0.00109939 2024-04-20T02:23:10.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.547+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:23:10.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.564+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:23:10.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.578+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:23:10.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.580+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:10.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.588+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:10.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.633+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:23:10.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.650+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:10.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.674+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:23:10.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.692+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:10.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.699+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:23:10.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.708+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:23:10.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.733+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:23:10.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.742+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:23:10.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.787+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:23:10.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:23:10.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:23:10.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.833+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:10.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:10.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.867+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:23:10.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.876+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:23:10.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.897+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:10.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.897+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:23:10.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.920+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:23:10.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.921+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:10.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:23:10.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:10.953+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:23:11.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:11.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.036+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:23:11.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.049+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:11.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:23:11.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.080+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:23:11.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.083+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:23:11.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.107+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:23:11.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:23:11.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.155+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:11.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.172+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:23:11.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.199+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:23:11.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.234+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:23:11.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.236+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:23:11.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:23:11.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.289+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:23:11.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.307+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:11.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:23:11.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.326+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:23:11.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.353+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:23:11.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.363+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:23:11.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:11.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:23:11.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.398+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:11.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:11.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.411+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:23:11.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:11.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.482+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:23:11.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.499+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:11.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.499+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:23:11.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.524+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:23:11.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.531+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:23:11.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 215 16 3087854 3087838 897.523 848.062 0.00107933 0.00109967 2024-04-20T02:23:11.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.562+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:11.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:11.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.573+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:23:11.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.600+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:23:11.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:23:11.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.614+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:23:11.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.626+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:23:11.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.631+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:23:11.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.665+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:23:11.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:23:11.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:11.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.724+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:23:11.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.745+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:23:11.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.752+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:23:11.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:23:11.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.792+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:23:11.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.796+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:11.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:11.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.834+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:23:11.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.834+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:23:11.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.840+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:23:11.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.873+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:23:11.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.880+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:23:11.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:23:11.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.892+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:12.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:23:12.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:11.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:23:12.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.046+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:12.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.051+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:12.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.068+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:23:12.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.081+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:12.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.082+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:23:12.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.087+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:23:12.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:23:12.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.122+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:23:12.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.149+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:23:12.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.158+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:23:12.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.172+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:23:12.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.206+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:23:12.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.217+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:23:12.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.244+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:12.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.247+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:23:12.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.287+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:23:12.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.319+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:23:12.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.326+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:23:12.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.334+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:23:12.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.342+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:23:12.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.359+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:23:12.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.375+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:12.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.386+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:23:12.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.403+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:23:12.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:12.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.417+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:12.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.435+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:23:12.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.441+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:23:12.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.454+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:23:12.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.464+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:23:12.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.474+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:23:12.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.480+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:12.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.482+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:23:12.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.508+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:23:12.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.525+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:23:12.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:23:12.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:23:12.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 216 16 3101718 3101702 897.379 866.5 0.00108358 0.00109985 2024-04-20T02:23:12.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.568+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:23:12.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.579+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:23:12.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.584+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:23:12.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:23:12.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.612+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:12.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.619+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:23:12.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.631+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:12.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.679+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:12.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.711+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:23:12.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.720+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:23:12.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.741+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:23:12.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.742+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:23:12.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:23:12.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:23:12.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.801+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:23:12.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:12.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.825+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:23:12.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.825+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:23:12.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.852+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:12.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.925+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:23:12.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.926+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:23:12.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:12.992+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:23:13.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.012+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:23:13.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.014+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:13.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.021+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:23:13.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:13.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.056+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:13.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.078+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:23:13.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.118+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:13.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.120+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:23:13.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.122+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:23:13.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.191+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:23:13.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.217+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:23:13.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.235+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:23:13.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.243+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:23:13.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.253+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:23:13.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.260+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:23:13.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.278+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:23:13.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:23:13.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.297+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:23:13.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.298+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:13.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:23:13.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.377+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:23:13.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.399+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:23:13.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.412+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:23:13.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.417+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:23:13.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.427+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:23:13.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.469+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:23:13.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.486+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:23:13.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.511+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:23:13.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.518+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:13.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 217 16 3116481 3116465 897.496 922.688 0.000883808 0.00109971 2024-04-20T02:23:13.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.566+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:23:13.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:13.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:23:13.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.613+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:23:13.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.635+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:23:13.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.657+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:23:13.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.689+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:23:13.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.706+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:23:13.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.720+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:13.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.723+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:23:13.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.759+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:13.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.761+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:23:13.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.762+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:13.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.799+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:23:13.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.818+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:23:13.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.834+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:23:13.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.852+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:13.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:23:13.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.900+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:23:13.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.912+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:23:13.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.932+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:23:13.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.932+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:13.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.963+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:13.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:13.996+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:14.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.001+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:14.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.001+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:23:14.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:23:14.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.033+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:23:14.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.052+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:23:14.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.059+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:23:14.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.072+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:14.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.090+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:23:14.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.100+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:23:14.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.118+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:23:14.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.130+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:23:14.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.144+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:23:14.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.164+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:23:14.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.172+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:14.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.189+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:23:14.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:14.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.238+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:14.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.241+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:14.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.257+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:23:14.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:23:14.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.289+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:23:14.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.343+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:23:14.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.345+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:14.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.372+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:23:14.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:23:14.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.426+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:23:14.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.426+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:23:14.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.442+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:23:14.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.485+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:23:14.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.514+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:23:14.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.533+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:23:14.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 218 16 3131304 3131288 897.628 926.438 0.000808462 0.00109955 2024-04-20T02:23:14.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.560+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:14.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.575+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:23:14.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.586+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:23:14.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.588+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:23:14.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.596+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:23:14.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.609+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:23:14.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.682+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:23:14.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.690+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:23:14.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.700+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:23:14.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.724+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:23:14.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.749+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:23:14.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:14.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.766+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:23:14.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:23:14.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:23:14.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:14.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.836+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:14.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.857+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:23:14.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.873+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:14.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.890+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:14.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.894+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:14.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.923+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:23:14.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.927+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:23:14.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.962+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:23:14.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.976+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:14.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.976+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:23:14.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.982+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:23:14.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:14.993+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:23:15.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.007+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:23:15.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.021+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:23:15.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.059+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:23:15.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.098+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:23:15.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:15.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.126+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:23:15.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.127+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:23:15.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.148+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:23:15.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.156+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:23:15.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.160+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:23:15.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.205+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:23:15.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.265+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:15.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.272+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:23:15.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.290+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:23:15.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.310+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:15.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:23:15.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.355+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:23:15.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.358+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:15.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.364+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:23:15.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:15.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.393+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:15.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.414+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:15.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.424+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:23:15.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.450+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:15.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.476+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:23:15.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.500+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:23:15.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.512+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:23:15.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:23:15.543 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 219 16 3146052 3146036 897.737 921.75 0.000740457 0.00109941 2024-04-20T02:23:15.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.559+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:23:15.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.561+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:23:15.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.576+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:23:15.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.585+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:15.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.586+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:23:15.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.654+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:23:15.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.658+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:23:15.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.677+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:23:15.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.700+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:23:15.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.714+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:23:15.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.726+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:15.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.729+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:23:15.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.754+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:23:15.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.770+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:23:15.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.775+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:23:15.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.794+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:23:15.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.829+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:23:15.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.841+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:23:15.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.841+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:23:15.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.884+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:23:15.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.905+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:23:15.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.915+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:23:15.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.918+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:23:15.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:23:15.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.960+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:23:15.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.976+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:23:15.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.976+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:23:15.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:15.977+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:23:16.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.072+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:23:16.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.086+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:23:16.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.113+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:16.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:23:16.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.162+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:16.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:23:16.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.219+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:23:16.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:23:16.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.261+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:23:16.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.272+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:23:16.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.279+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:23:16.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.282+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:23:16.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.285+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:16.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:23:16.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:23:16.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.337+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:16.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:16.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.367+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:16.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.395+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:23:16.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.399+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:23:16.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.427+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:16.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.436+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:23:16.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.450+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:23:16.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.464+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:23:16.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.467+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:23:16.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.474+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:23:16.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.482+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:23:16.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.525+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:23:16.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:23:16.545432+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00109976 2024-04-20T02:23:16.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:23:16.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 220 15 3159415 3159400 897.452 835.25 0.000814107 0.00109976 2024-04-20T02:23:16.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.556+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:23:16.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.571+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:23:16.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.593+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:23:16.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.593+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:23:16.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.595+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:16.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:16.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.662+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:16.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.682+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:23:16.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.683+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:23:16.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.693+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:23:16.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.739+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:23:16.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.745+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:23:16.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:23:16.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.791+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:23:16.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.801+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:23:16.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.806+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:16.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.807+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:23:16.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.827+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:23:16.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.854+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:16.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.858+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:16.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:23:16.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:23:16.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.901+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:23:16.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.912+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:16.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.936+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:23:16.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.940+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:16.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.953+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:23:16.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.976+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:23:16.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:16.990+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:23:17.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:23:17.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.009+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:23:17.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.063+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:17.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.090+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:17.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.090+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:17.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.121+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:23:17.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.146+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:17.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.153+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:23:17.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.156+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:17.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.177+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:23:17.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.211+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:23:17.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.221+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:17.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.257+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:23:17.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.279+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:17.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.298+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:23:17.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.309+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:23:17.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.327+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:23:17.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.346+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:23:17.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.351+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:23:17.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.355+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:23:17.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.385+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:23:17.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.393+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:17.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.424+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:23:17.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.431+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:23:17.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:23:17.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.498+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:17.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.504+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:23:17.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.537+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:17.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 221 15 3173996 3173981 897.515 911.312 0.000723838 0.00109968 2024-04-20T02:23:17.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.547+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:17.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.555+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:23:17.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.587+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:23:17.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.601+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:23:17.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.678+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:23:17.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.683+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:23:17.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.699+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:17.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.706+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:23:17.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.715+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:23:17.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.767+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:17.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:23:17.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.809+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:23:17.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.827+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:17.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.839+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:23:17.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.852+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:23:17.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.865+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:23:17.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:23:17.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.877+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:23:17.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.894+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:23:17.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.921+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:17.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.935+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:23:17.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.965+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:23:17.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:17.979+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:23:18.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.005+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:23:18.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.021+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:23:18.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.029+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:23:18.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.061+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:23:18.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.091+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:23:18.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.095+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:23:18.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.109+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:23:18.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.150+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:23:18.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.178+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:23:18.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.189+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:18.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:23:18.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:18.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.231+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:23:18.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.240+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:23:18.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:18.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.255+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:23:18.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.278+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:23:18.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.281+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:23:18.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.304+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:23:18.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.323+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:23:18.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.328+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:23:18.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.342+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:23:18.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.358+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:23:18.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.391+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:23:18.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.404+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:23:18.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.414+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:23:18.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.438+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:23:18.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:18.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.459+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:23:18.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.462+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:23:18.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.482+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:23:18.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.501+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:23:18.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.505+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:23:18.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.518+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:23:18.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 222 16 3188072 3188056 897.434 879.688 0.000681358 0.00109979 2024-04-20T02:23:18.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.568+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:23:18.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.580+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:23:18.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.593+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:18.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.644+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:23:18.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.650+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:23:18.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.651+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:18.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.682+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:18.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.688+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:23:18.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.694+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:23:18.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.710+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:23:18.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.711+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:18.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.725+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:23:18.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:23:18.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.765+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:23:18.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.785+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:23:18.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.803+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:23:18.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.829+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:23:18.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.872+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:23:18.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.889+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:23:18.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.892+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:23:18.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.966+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:23:18.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:23:18.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:18.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:23:19.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:23:19.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.022+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:23:19.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.040+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:19.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.049+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:23:19.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.085+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:23:19.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.093+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:23:19.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.107+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:19.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.112+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:19.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.118+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:23:19.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.139+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:23:19.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.167+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:23:19.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.173+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:23:19.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.196+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:23:19.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:23:19.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:19.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.267+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:23:19.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.270+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:19.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.293+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:23:19.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.297+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:23:19.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.299+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:19.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:23:19.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.340+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:19.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.361+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:23:19.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.389+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:23:19.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.390+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:23:19.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.413+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:23:19.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.448+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:23:19.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.449+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:23:19.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.481+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:23:19.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.481+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:23:19.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.497+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:23:19.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.508+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:19.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.515+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:23:19.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 223 16 3202755 3202739 897.524 917.688 0.000961974 0.00109968 2024-04-20T02:23:19.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.555+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:23:19.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:19.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.594+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:23:19.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.613+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:23:19.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:19.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.681+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:19.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.686+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:19.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.700+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:23:19.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.717+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:19.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:23:19.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:23:19.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.761+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:23:19.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.765+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:23:19.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.769+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:23:19.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.796+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:23:19.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.812+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:23:19.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.819+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:23:19.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.847+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:23:19.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:19.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.881+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:23:19.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.896+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:23:19.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.907+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:23:19.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:23:19.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.925+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:23:19.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.953+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:23:19.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.958+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:23:19.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.974+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:23:19.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:19.978+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:23:20.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.005+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:23:20.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:23:20.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:20.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.070+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:23:20.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.079+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:23:20.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.083+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:20.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.102+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:20.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.168+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:23:20.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.172+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:23:20.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.196+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:20.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.213+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:23:20.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.215+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:23:20.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.233+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:23:20.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.249+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:23:20.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:23:20.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.274+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:23:20.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:23:20.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.300+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:23:20.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.313+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:20.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.347+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:23:20.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.393+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:23:20.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.405+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:20.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.418+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:23:20.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.467+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:23:20.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.480+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:23:20.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.480+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:23:20.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.507+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:20.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.514+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:20.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.535+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:23:20.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.539+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:23:20.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 224 16 3217370 3217354 897.595 913.438 0.000887538 0.00109958 2024-04-20T02:23:20.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.546+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:20.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.556+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:23:20.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.585+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:20.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.610+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:20.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.616+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:23:20.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:23:20.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.663+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:23:20.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.685+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:23:20.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.718+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:23:20.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.737+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:23:20.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.756+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:23:20.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.775+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:20.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.779+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:23:20.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.801+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:23:20.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.857+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:23:20.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.882+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:23:20.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.897+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:23:20.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.909+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:20.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.925+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:23:20.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.947+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:20.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.959+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:23:20.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.964+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:23:20.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:20.976+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:23:21.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.002+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:23:21.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.006+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:21.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.050+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:23:21.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.053+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:23:21.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.068+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:23:21.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.086+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:23:21.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.086+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:21.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.118+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:23:21.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.141+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:21.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.154+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:23:21.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.183+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:23:21.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.198+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:21.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.201+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:23:21.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.230+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:23:21.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.238+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:23:21.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.274+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:23:21.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.289+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:21.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:23:21.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.342+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:23:21.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.352+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:21.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:23:21.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.426+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:21.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.440+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:21.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:23:21.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.457+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:23:21.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:23:21.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.483+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:23:21.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.506+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:23:21.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.518+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:21.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.528+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:23:21.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 225 16 3231903 3231887 897.642 908.312 0.000704312 0.00109953 2024-04-20T02:23:21.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.566+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:23:21.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.580+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:23:21.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.598+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:23:21.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.610+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:23:21.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.646+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:23:21.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.662+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:23:21.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.668+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:23:21.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.675+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:23:21.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.699+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:21.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.704+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:23:21.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.741+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:21.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.766+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:21.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.768+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:21.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:23:21.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.805+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:21.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.818+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:23:21.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.843+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:23:21.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.868+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:23:21.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:23:21.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.921+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:23:21.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.923+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:23:21.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.934+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:23:21.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.952+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:23:21.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.965+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:23:21.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:21.989+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:23:22.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.002+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:22.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.004+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:23:22.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:23:22.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.063+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:23:22.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.067+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:23:22.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.101+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:22.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.109+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:23:22.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.130+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:23:22.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.139+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:23:22.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.141+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:22.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.191+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:22.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.214+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:23:22.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.238+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:23:22.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.252+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:23:22.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.259+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:22.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.326+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:23:22.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.342+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:23:22.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.369+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:23:22.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.373+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:23:22.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.394+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:23:22.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:22.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.425+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:23:22.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.426+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:23:22.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.462+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:23:22.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.463+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:23:22.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.479+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:23:22.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.524+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:23:22.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.530+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:23:22.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.537+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:23:22.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 226 16 3246705 3246689 897.763 925.125 0.0007087 0.00109938 2024-04-20T02:23:22.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.547+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:23:22.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.558+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:23:22.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.560+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:23:22.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.573+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:22.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.595+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:23:22.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:23:22.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.624+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:22.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.629+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:23:22.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.729+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:23:22.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.741+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:23:22.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.753+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:22.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.762+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:23:22.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.777+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:23:22.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.788+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:23:22.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:23:22.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.820+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:23:22.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.833+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:23:22.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.862+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:22.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.863+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:22.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.879+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:22.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.905+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:23:22.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.909+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:23:22.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.944+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:22.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.957+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:23:22.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:22.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:23:23.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.010+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:23:23.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.026+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:23:23.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.043+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:23:23.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.057+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:23:23.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.058+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:23.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.071+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:23:23.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.102+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:23:23.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.106+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:23:23.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.119+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:23.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.120+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:23:23.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.145+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:23:23.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.147+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:23:23.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.196+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:23:23.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.216+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:23:23.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.228+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:23:23.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:23:23.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.279+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:23:23.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.347+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:23.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.368+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:23:23.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.376+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:23.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.399+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:23.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.403+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:23.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:23:23.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.449+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:23:23.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.454+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:23:23.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.458+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:23:23.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.483+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:23:23.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.504+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:23:23.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.510+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:23:23.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.536+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:23.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.543+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:23:23.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 227 15 3260397 3260382 897.578 855.812 0.000744119 0.00109961 2024-04-20T02:23:23.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.563+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:23.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.570+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:23:23.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.613+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:23.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.630+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:23.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.643+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:23:23.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.643+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:23.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.646+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:23:23.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.674+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:23:23.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.706+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:23.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.718+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:23:23.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.722+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:23:23.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.746+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:23.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.751+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:23:23.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.759+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:23:23.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.775+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:23.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:23.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:23:23.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.801+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:23:23.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.808+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:23:23.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.844+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:23:23.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.860+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:23.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.868+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:23:23.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.880+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:23.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:23:23.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.899+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:23:23.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.918+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:23:23.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.928+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:23:23.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.942+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:23:23.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.942+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:23:23.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:23.979+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:24.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.012+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:24.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.029+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:23:24.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.034+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:24.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.051+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:24.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.066+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:23:24.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.069+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:23:24.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.071+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:23:24.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.088+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:23:24.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.108+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:23:24.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.109+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:23:24.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.149+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:24.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.163+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:23:24.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.176+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:24.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.179+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:24.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:23:24.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.234+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:23:24.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.246+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:23:24.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.249+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:23:24.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.283+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:23:24.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.302+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:24.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:24.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.336+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:23:24.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:23:24.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.366+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:23:24.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.380+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:23:24.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:23:24.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.404+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:23:24.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.435+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:23:24.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.467+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:23:24.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.468+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:24.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.497+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:24.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.537+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:23:24.544 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 228 16 3275085 3275069 897.667 917.938 0.000654362 0.00109949 2024-04-20T02:23:24.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.554+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:23:24.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.565+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:23:24.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.588+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:23:24.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.599+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:23:24.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.617+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:24.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.638+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:23:24.649 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.649+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:23:24.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:23:24.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.677+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:23:24.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:23:24.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.717+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:23:24.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.738+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:23:24.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.740+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:24.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.763+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:23:24.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.782+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:23:24.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.784+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:23:24.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.830+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:23:24.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.832+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:23:24.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.848+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:24.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:24.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.869+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:23:24.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.882+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:23:24.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.893+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:23:24.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.903+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:24.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:23:24.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.933+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:23:24.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.946+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:23:24.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.953+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:23:24.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.961+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:23:24.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:24.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:23:25.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.003+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:23:25.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.018+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:23:25.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.021+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:23:25.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.045+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:23:25.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.070+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:23:25.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.077+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:23:25.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.081+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:23:25.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.100+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:23:25.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.106+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:23:25.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.109+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:23:25.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.122+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:23:25.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.136+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:23:25.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.159+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:23:25.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.164+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:23:25.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.171+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:23:25.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.202+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:23:25.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.217+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:23:25.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.218+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:23:25.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.249+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:23:25.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.254+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:23:25.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.270+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:23:25.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:23:25.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.279+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:23:25.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.303+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:23:25.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.324+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:23:25.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.361+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:25.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.367+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:23:25.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:25.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.428+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:23:25.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.434+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:23:25.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.460+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:23:25.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.484+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:23:25.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.509+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:23:25.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.514+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:23:25.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.532+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:23:25.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.535+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:23:25.545 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 229 15 3289519 3289504 897.686 902.188 0.000705596 0.00109947 2024-04-20T02:23:25.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.552+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:23:25.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.555+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:25.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.581+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:23:25.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.600+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:23:25.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.632+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:23:25.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.674+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:23:25.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.681+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:23:25.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.701+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:25.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.704+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:23:25.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.738+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:23:25.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.768+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:23:25.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.780+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:25.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:25.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.813+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:23:25.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.837+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:23:25.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.846+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:23:25.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.873+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:23:25.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.880+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:25.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.898+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:23:25.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.916+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:23:25.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.918+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:25.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:25.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:25.944+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:23:26.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.001+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:26.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.005+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:26.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.033+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:23:26.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.048+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:26.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.050+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:26.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.098+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:26.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.109+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:23:26.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.125+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:26.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.129+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:23:26.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.131+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:23:26.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.162+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:26.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.208+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:23:26.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.211+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:23:26.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.229+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:23:26.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:23:26.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.262+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:23:26.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.266+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:23:26.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.268+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:23:26.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.305+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:23:26.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.311+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:23:26.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.317+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:23:26.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:23:26.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.362+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:23:26.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.393+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:26.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:23:26.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.412+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:23:26.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.426+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:23:26.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.430+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:26.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.459+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:23:26.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.495+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:23:26.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.529+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:23:26.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.540+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:23:26.545 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 230 16 3303988 3303972 897.714 904.25 0.000741182 0.00109944 2024-04-20T02:23:26.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.550+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:23:26.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:23:26.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.613+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:23:26.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.651+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:23:26.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.661+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:23:26.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.682+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:26.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.687+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:26.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.697+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:23:26.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.723+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:26.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.740+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:23:26.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.752+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:23:26.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:23:26.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.810+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:23:26.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.822+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:23:26.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.869+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:23:26.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.938+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:23:26.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.962+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:26.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:26.987+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:23:27.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.002+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:23:27.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.006+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:23:27.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:23:27.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.040+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:27.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.075+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:23:27.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.093+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:27.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.200+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:23:27.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.203+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:27.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.225+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:23:27.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.240+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:23:27.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.266+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:27.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.268+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:23:27.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.309+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:23:27.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:23:27.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.401+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:23:27.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.423+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:27.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.434+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:23:27.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.449+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:23:27.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.503+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:23:27.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.509+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:23:27.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:27.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:23:27.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:23:27.545 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 231 16 3316279 3316263 897.153 768.188 0.000947442 0.00110014 2024-04-20T02:23:27.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.556+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:27.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.563+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:23:27.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.566+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:23:27.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.613+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:23:27.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.627+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:27.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.649+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:23:27.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.757+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:23:27.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.773+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:23:27.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.795+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:23:27.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.813+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:23:27.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.850+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:23:27.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.859+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:23:27.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.861+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:23:27.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.899+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:23:27.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.927+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:23:27.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.941+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:23:27.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.942+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:23:27.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.951+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:27.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.964+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:23:27.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.974+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:23:27.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:27.993+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:23:28.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.015+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:23:28.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.024+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:23:28.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.046+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:28.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.051+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:23:28.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.075+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:23:28.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:28.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.089+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:23:28.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.112+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:28.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.117+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:23:28.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.124+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:23:28.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.172+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:23:28.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.209+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:28.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.241+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:28.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.253+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:28.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.263+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:23:28.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.282+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:28.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.290+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:23:28.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.300+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:23:28.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.354+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:28.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.364+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:23:28.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.370+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:28.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.388+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:23:28.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.391+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:23:28.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.407+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:23:28.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.408+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:23:28.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.410+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:28.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.432+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:23:28.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.439+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:23:28.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.446+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:23:28.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.452+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:28.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.490+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:23:28.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.508+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:28.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.510+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:23:28.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.514+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:23:28.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:23:28.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.544+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:23:28.545 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 232 16 3329507 3329491 896.849 826.75 0.000882547 0.00110051 2024-04-20T02:23:28.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.556+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:23:28.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.557+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:28.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:23:28.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.594+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:23:28.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.618+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:28.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.631+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:23:28.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.633+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:23:28.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.655+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:23:28.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.662+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:23:28.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.689+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:23:28.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.733+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:23:28.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:23:28.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.755+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:23:28.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.792+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:23:28.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.811+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:28.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:23:28.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.834+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:23:28.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.853+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:28.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.874+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:23:28.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.911+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:28.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.960+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:23:28.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.988+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:28.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:28.992+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:23:29.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.019+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:23:29.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.035+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:23:29.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.039+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:23:29.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:23:29.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.060+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:29.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.084+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:23:29.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.090+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:29.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.092+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:29.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.112+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:23:29.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.122+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:23:29.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.147+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:23:29.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.176+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:23:29.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.219+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:23:29.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.226+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:23:29.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.237+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:23:29.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:23:29.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.263+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:23:29.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.306+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:23:29.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.307+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:29.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.362+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:23:29.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.391+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:29.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.408+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:23:29.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.409+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:23:29.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.426+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:23:29.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.432+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:29.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.442+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:23:29.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:29.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.500+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:23:29.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.502+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:23:29.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:29.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.536+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:23:29.545 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 233 15 3344240 3344225 896.952 920.875 0.000947407 0.00110038 2024-04-20T02:23:29.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.550+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:23:29.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.571+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:29.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.591+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:29.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.596+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:23:29.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.607+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:29.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.618+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:23:29.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.638+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:23:29.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.651+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:23:29.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.671+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:23:29.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.695+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:23:29.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.698+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:23:29.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.712+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:23:29.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.729+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:23:29.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.878+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:23:29.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.916+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:29.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.940+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:29.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.941+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:29.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.972+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:23:29.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:29.985+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:23:30.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.030+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:30.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.032+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:30.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.059+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:23:30.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.073+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:30.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.093+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:23:30.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:23:30.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.111+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:23:30.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.125+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:23:30.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.138+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:30.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.149+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:23:30.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.162+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:23:30.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.181+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:30.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.198+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:30.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.212+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:30.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.246+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:23:30.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.265+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:23:30.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.291+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:23:30.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.326+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:23:30.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.344+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:30.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.352+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:23:30.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.384+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:23:30.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.387+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:23:30.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.407+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:23:30.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.436+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:23:30.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:23:30.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.466+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:30.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.474+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:30.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:23:30.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.526+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:23:30.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.540+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:23:30.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.541+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:23:30.545 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 234 16 3357144 3357128 896.565 806.438 0.0006936 0.00110086 2024-04-20T02:23:30.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.548+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:23:30.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.558+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:30.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:23:30.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.578+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:30.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.617+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:23:30.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.618+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:23:30.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.632+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:23:30.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.654+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:30.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.661+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:23:30.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.664+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:23:30.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.685+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:23:30.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.690+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:23:30.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.727+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:23:30.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:23:30.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.760+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:23:30.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.762+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:23:30.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.785+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:23:30.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.829+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:23:30.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.830+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:30.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.838+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:23:30.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.893+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:23:30.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.954+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:23:30.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:30.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:23:31.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.014+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:23:31.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.020+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:23:31.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.035+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:23:31.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.051+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:23:31.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.066+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:31.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.071+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:31.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.092+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:23:31.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.106+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:31.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.108+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:23:31.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.123+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:23:31.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.149+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:23:31.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.162+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:31.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.183+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:23:31.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.196+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:23:31.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.208+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:23:31.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.231+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:23:31.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.269+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:23:31.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.281+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:23:31.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.305+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:31.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.309+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:23:31.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.318+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:31.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:31.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.366+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:31.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.369+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:31.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.372+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:23:31.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.401+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:23:31.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.401+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:23:31.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.440+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:31.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.447+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:23:31.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.463+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:23:31.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.466+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:23:31.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.469+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:23:31.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.482+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:23:31.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.519+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:31.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 235 16 3371722 3371706 896.625 911.125 0.00107499 0.00110079 2024-04-20T02:23:31.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.553+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:23:31.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.579+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:23:31.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.594+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:31.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.594+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:23:31.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.604+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:23:31.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.628+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:23:31.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.668+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:31.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.707+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:31.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.729+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:23:31.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.738+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:31.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.750+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:23:31.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.751+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:31.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.784+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:31.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.785+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:23:31.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.813+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:23:31.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.859+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:23:31.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.867+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:23:31.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.894+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:23:31.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.894+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:23:31.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.919+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:23:31.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:31.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.932+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:23:31.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.955+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:23:31.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.978+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:23:31.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:31.995+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:23:32.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.018+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:23:32.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.037+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:32.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.047+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:32.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.076+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:23:32.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.084+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:23:32.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.114+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:32.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.120+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:32.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.148+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:23:32.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.173+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:32.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.187+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:23:32.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.231+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:23:32.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.249+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:23:32.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.273+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:23:32.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.275+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:23:32.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.318+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:23:32.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.353+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:32.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.370+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:32.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:23:32.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.403+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:23:32.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.424+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:32.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.428+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:23:32.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.429+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:32.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.464+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:32.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:32.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.484+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:23:32.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.499+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:23:32.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.530+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:23:32.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 236 16 3386576 3386560 896.76 928.375 0.000951026 0.00110062 2024-04-20T02:23:32.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.560+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:23:32.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.589+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:32.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.591+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:23:32.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.628+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:32.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.632+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:23:32.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:23:32.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.663+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:32.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.676+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:32.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.685+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:23:32.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.689+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:23:32.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.693+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:23:32.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.722+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:23:32.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.765+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:23:32.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.807+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:23:32.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.817+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:23:32.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.817+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:32.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.837+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:23:32.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.858+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:23:32.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.860+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:23:32.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.881+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:23:32.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.931+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:23:32.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.939+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:32.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.963+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:23:32.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.986+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:23:32.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:32.987+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:33.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.002+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:23:33.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.015+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:23:33.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.041+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:23:33.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.052+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:23:33.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.056+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:33.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.075+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:23:33.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.106+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:33.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.120+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:23:33.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.138+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:23:33.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.148+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:23:33.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.155+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:23:33.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.201+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:33.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.222+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:23:33.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:33.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.263+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:33.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.267+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:23:33.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.271+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:33.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.300+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:23:33.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.301+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:23:33.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.313+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:23:33.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.327+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:23:33.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:23:33.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.349+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:23:33.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.359+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:33.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.381+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:23:33.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.404+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:23:33.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:23:33.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.413+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:33.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.450+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:33.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.451+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:23:33.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.503+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:23:33.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.505+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:33.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.508+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:33.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 237 16 3401245 3401229 896.844 916.812 0.0020648 0.00110052 2024-04-20T02:23:33.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.546+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:33.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.548+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:23:33.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.592+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:33.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.592+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:33.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.618+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:33.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.650+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:23:33.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.678+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:23:33.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.683+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:23:33.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.701+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:33.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.729+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:23:33.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.734+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:23:33.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.747+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:23:33.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.747+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:23:33.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.769+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:23:33.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.781+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:23:33.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.813+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:33.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.813+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:33.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.837+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:23:33.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.862+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:23:33.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.869+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:23:33.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.875+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:33.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.892+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:33.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.894+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:33.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.903+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:23:33.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.926+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:33.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.947+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:23:33.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:33.947+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:34.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.022+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:23:34.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:23:34.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.046+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:23:34.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.052+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:34.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.071+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:23:34.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.095+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:23:34.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.102+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:23:34.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.135+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:34.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.142+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:34.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.150+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:23:34.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:34.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.214+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:23:34.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.229+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:23:34.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.247+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:23:34.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.249+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:23:34.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:34.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.308+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:34.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.316+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:23:34.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.330+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:34.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.341+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:23:34.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:23:34.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.385+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:23:34.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.413+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:34.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.427+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:34.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:23:34.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.449+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:23:34.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.465+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:23:34.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.471+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:23:34.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.513+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:23:34.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.531+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:34.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 238 16 3415792 3415776 896.895 909.188 0.00143045 0.00110044 2024-04-20T02:23:34.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.599+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:23:34.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.610+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:23:34.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.664+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:23:34.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.685+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:34.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:34.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:23:34.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.711+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:23:34.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.728+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:23:34.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.734+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:23:34.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.776+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:23:34.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.797+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:34.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:23:34.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.819+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:34.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.821+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:23:34.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.834+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:34.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.865+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:23:34.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.884+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:23:34.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:23:34.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.912+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:23:34.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.936+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:23:34.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.942+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:23:34.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.949+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:34.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:34.970+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:23:35.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.003+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:23:35.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.005+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:23:35.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.038+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:35.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.051+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:23:35.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.051+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:23:35.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.085+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:23:35.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.096+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:23:35.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.102+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:23:35.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:35.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.110+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:35.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.134+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:23:35.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.134+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:23:35.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.154+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:35.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.167+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:23:35.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.168+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:23:35.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.173+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:23:35.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.225+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:23:35.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.230+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:23:35.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.252+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:23:35.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.259+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:35.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.272+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:23:35.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.273+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:23:35.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.280+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:23:35.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.307+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:35.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.311+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:23:35.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.342+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:23:35.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.346+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:23:35.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.356+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:23:35.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.363+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:23:35.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.389+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:23:35.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.390+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:35.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.391+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:23:35.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.436+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:23:35.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.441+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:23:35.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:23:35.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.476+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:23:35.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.501+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:23:35.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.508+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:23:35.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.518+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:23:35.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.522+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:23:35.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 239 16 3429590 3429574 896.751 862.375 0.000659403 0.00110064 2024-04-20T02:23:35.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.560+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:35.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.564+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:23:35.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.586+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:23:35.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.596+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:23:35.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.615+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:35.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.635+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:23:35.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.641+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:23:35.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.664+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:23:35.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:23:35.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.685+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:23:35.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.730+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:23:35.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.745+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:23:35.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.750+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:35.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.769+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:23:35.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:23:35.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.831+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:35.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.842+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:23:35.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.853+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:23:35.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.874+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:23:35.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.914+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:35.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.937+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:35.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.963+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:23:35.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:35.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:36.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:23:36.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.051+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:23:36.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.065+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:23:36.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.082+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:23:36.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.083+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:23:36.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.088+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:23:36.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.141+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:23:36.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.144+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:23:36.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:23:36.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.179+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:23:36.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.181+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:23:36.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.209+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:23:36.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.228+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:23:36.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.231+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:36.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.252+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:23:36.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.266+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:23:36.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.273+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:23:36.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.295+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:23:36.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.304+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:23:36.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.326+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:23:36.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.339+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:36.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:23:36.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.377+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:23:36.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.404+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:23:36.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.417+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:23:36.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.428+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:23:36.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.450+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:23:36.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.465+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:23:36.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.480+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:23:36.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.504+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:23:36.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.528+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:23:36.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:23:36.547774+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00110056 2024-04-20T02:23:36.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:23:36.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 240 16 3444171 3444155 896.811 911.312 0.000523271 0.00110056 2024-04-20T02:23:36.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.566+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:36.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.570+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:23:36.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.607+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:23:36.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.621+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:23:36.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.637+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:23:36.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.669+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:23:36.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.681+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:23:36.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.690+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:23:36.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:23:36.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.744+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:23:36.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.768+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:23:36.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:23:36.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.787+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:23:36.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.829+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:36.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.849+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:36.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.899+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:36.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.899+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:23:36.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.901+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:23:36.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.938+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:23:36.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.950+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:23:36.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.964+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:36.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.968+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:36.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:36.977+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:23:37.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.010+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:23:37.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:23:37.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:37.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.054+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:37.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.071+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:37.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.078+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:23:37.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.101+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:37.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.106+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:23:37.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.126+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:23:37.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:37.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.166+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:23:37.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.178+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:37.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:23:37.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.208+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:23:37.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.211+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:23:37.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.251+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:23:37.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.281+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:23:37.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.299+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:37.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.347+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:23:37.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.370+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:23:37.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.378+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:23:37.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.395+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:37.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.397+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:23:37.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.438+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:23:37.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.448+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:23:37.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.466+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:23:37.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.471+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:37.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.493+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:23:37.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.494+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:23:37.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.524+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:23:37.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.542+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:23:37.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 241 16 3458846 3458830 896.895 917.188 0.00174139 0.00110046 2024-04-20T02:23:37.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.550+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:37.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.565+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:23:37.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.571+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:23:37.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.583+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:37.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.591+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:23:37.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.617+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:23:37.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.633+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:37.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.645+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:23:37.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.663+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:23:37.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.679+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:23:37.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:23:37.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.705+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:37.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.732+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:37.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.758+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:23:37.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.772+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:23:37.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.797+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:23:37.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:37.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.826+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:23:37.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.832+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:23:37.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.843+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:23:37.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.866+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:23:37.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.867+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:37.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.879+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:23:37.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:23:37.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.905+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:37.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:37.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.933+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:23:37.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:37.972+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:23:38.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.015+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:38.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.026+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:23:38.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.059+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:23:38.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.059+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:23:38.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.063+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:23:38.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:23:38.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.087+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:23:38.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.109+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:38.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.161+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:38.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.163+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:23:38.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:23:38.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.210+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:23:38.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.236+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:38.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.260+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:23:38.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.266+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:38.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.281+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:23:38.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.282+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:23:38.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.302+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:23:38.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.322+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:38.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.329+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:38.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.340+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:38.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.343+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:23:38.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.368+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:38.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.371+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:23:38.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.405+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:23:38.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.406+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:23:38.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.410+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:23:38.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.438+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:23:38.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.446+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:38.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.468+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:23:38.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.475+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:38.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.493+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:38.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.521+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:23:38.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 242 16 3472925 3472909 896.825 879.938 0.000781848 0.00110055 2024-04-20T02:23:38.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.581+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:23:38.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:23:38.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.588+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:38.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.627+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:23:38.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.658+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:23:38.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.659+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:23:38.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.695+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:23:38.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.706+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:23:38.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.767+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:38.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.809+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:23:38.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.841+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:23:38.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.867+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:23:38.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.893+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:23:38.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.922+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:23:38.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.922+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:23:38.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.935+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:23:38.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.954+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:38.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.960+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:23:38.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.975+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:23:38.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.977+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:23:38.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:38.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:23:39.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.007+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:23:39.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.063+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:39.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.095+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:23:39.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.146+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:23:39.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.153+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:23:39.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.155+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:23:39.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.180+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:23:39.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.202+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:23:39.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.221+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:23:39.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.248+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:23:39.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.256+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:23:39.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.282+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:39.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:39.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:23:39.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.349+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:39.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:23:39.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:23:39.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.411+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:23:39.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.422+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:23:39.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.427+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:23:39.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.444+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:23:39.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.467+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:39.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.503+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:39.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.522+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:23:39.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.526+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:23:39.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.543+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:39.546 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 243 15 3487861 3487846 896.976 933.562 0.000778593 0.00110036 2024-04-20T02:23:39.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.571+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:39.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:23:39.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.616+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:23:39.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.633+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:23:39.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.638+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:23:39.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.685+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:23:39.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.701+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:39.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.708+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:23:39.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.730+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:39.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:23:39.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.773+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:23:39.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.797+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:23:39.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:23:39.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.833+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:23:39.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.840+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:23:39.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.870+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:23:39.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.884+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:39.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:23:39.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.944+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:23:39.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.962+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:23:39.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:23:39.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:39.999+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:23:40.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.036+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:40.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.056+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:23:40.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.104+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:23:40.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.122+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:40.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.147+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:23:40.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.195+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:40.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.202+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:23:40.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.218+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:40.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.247+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:23:40.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.249+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:40.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.261+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:23:40.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:40.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:23:40.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.325+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:23:40.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.334+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:40.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.337+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:23:40.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.349+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:23:40.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:40.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.357+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:23:40.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:23:40.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.401+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:23:40.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.412+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:23:40.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.435+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:23:40.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.444+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:23:40.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.464+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:40.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.465+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:23:40.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.479+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:23:40.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.494+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:40.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.501+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:23:40.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.523+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:40.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.539+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:23:40.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 244 16 3502469 3502453 897.041 912.938 0.000528034 0.00110027 2024-04-20T02:23:40.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.571+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:23:40.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.590+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:23:40.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.608+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:23:40.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.634+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:23:40.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.665+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:23:40.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:23:40.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.692+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:40.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.694+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:23:40.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.708+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:23:40.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.724+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:23:40.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.770+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:23:40.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.771+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:23:40.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.777+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:23:40.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:40.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.831+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:23:40.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.842+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:23:40.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.843+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:23:40.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.857+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:23:40.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.884+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:23:40.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.886+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:23:40.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.918+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:23:40.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:23:40.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.932+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:23:40.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.961+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:23:40.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:40.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:41.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.003+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:23:41.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.010+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:23:41.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.068+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:23:41.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:23:41.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.090+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:23:41.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.105+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:41.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.109+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:23:41.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.112+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:23:41.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.124+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:23:41.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.163+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:41.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.186+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:41.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.234+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:23:41.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.239+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:23:41.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.255+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:23:41.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.280+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:23:41.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.287+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:23:41.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.324+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:23:41.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.324+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:41.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:23:41.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.352+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:41.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.366+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:41.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.379+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:23:41.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.415+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:23:41.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.415+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:41.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.443+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:41.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:23:41.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.462+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:41.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.464+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:23:41.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.472+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:23:41.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 245 16 3517075 3517059 897.105 912.875 0.000763052 0.0011002 2024-04-20T02:23:41.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:41.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.578+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:23:41.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:23:41.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.597+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:41.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.623+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:23:41.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:23:41.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.639+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:23:41.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.661+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:41.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.662+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:41.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.711+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:23:41.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.731+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:23:41.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.765+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:41.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.817+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:23:41.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.827+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:23:41.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:41.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:41.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.903+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:41.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.929+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:41.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.965+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:23:41.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.979+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:23:41.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:41.984+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:42.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.012+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:42.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.033+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:42.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.040+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:42.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.075+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:23:42.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.089+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:42.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.111+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:23:42.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.117+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:23:42.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.147+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:23:42.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.168+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:23:42.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:42.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.199+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:42.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.206+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:23:42.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.236+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:23:42.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.250+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:23:42.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.269+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:23:42.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.283+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:23:42.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.292+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:23:42.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.320+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:23:42.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.335+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:42.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.350+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:23:42.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.354+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:23:42.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:23:42.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.392+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:23:42.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:42.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.414+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:23:42.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.433+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:23:42.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.446+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:23:42.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.477+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:23:42.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.495+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:42.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.502+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:23:42.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.525+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:42.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.526+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:23:42.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.543+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:42.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 246 15 3531674 3531659 897.167 912.5 0.00109547 0.00110011 2024-04-20T02:23:42.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.549+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:23:42.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.584+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:23:42.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:42.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:42.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.629+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:23:42.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.670+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:23:42.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.695+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:23:42.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.723+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:23:42.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.728+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:23:42.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:23:42.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.764+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:23:42.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:23:42.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.834+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:23:42.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.851+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:42.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:23:42.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.893+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:42.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:23:42.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.919+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:23:42.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.934+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:23:42.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.949+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:42.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.969+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:42.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.978+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:23:43.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:42.999+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:23:43.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:23:43.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.013+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:23:43.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.038+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:23:43.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.048+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:43.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.076+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:23:43.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.100+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:23:43.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.104+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:43.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.115+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:23:43.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.121+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:43.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.125+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:23:43.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.152+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:43.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.181+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:23:43.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.181+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:43.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.202+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:43.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.232+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:43.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.244+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:23:43.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.254+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:23:43.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.271+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:23:43.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.281+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:23:43.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.293+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:43.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.333+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:43.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.339+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:23:43.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:23:43.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.364+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:43.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.405+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:23:43.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.426+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:23:43.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:23:43.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.448+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:23:43.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.467+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:43.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.514+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:23:43.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.521+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:43.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.528+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:23:43.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.541+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:43.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.543+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:23:43.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 247 16 3546155 3546139 897.199 905 0.000482858 0.00110007 2024-04-20T02:23:43.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.571+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:23:43.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.576+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:23:43.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:23:43.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.609+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:43.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.649+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:23:43.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.654+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:23:43.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.665+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:23:43.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.678+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:43.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.682+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:23:43.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.695+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:23:43.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.709+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:23:43.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.733+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:23:43.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.777+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:23:43.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.796+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:23:43.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.815+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:23:43.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.816+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:43.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.843+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:23:43.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.844+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:23:43.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.872+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:23:43.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.880+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:43.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.888+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:23:43.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.906+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:23:43.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.919+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:43.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.956+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:23:43.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:43.968+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:44.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:44.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:23:44.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.035+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:23:44.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.040+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:23:44.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.073+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:44.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.073+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:23:44.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.091+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:23:44.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.104+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:23:44.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.107+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:23:44.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.126+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:23:44.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.142+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:44.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.168+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:23:44.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.180+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:23:44.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.181+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:44.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.206+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:23:44.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.210+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:44.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.214+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:23:44.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.235+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:23:44.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.239+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:23:44.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.248+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:23:44.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.255+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:23:44.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.271+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:44.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.322+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:23:44.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.329+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:23:44.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.333+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:23:44.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.339+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:44.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:23:44.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.434+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:23:44.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:23:44.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:23:44.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.484+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:23:44.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.490+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:44.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.518+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:23:44.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.518+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:23:44.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.536+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:23:44.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 248 16 3560641 3560625 897.231 905.375 0.00179789 0.00110004 2024-04-20T02:23:44.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.557+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:44.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.576+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:44.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.586+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:23:44.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.629+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:44.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.658+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:23:44.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.680+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:23:44.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.691+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:44.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.736+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:23:44.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.766+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:23:44.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.848+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:23:44.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.851+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:23:44.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.874+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:23:44.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.883+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:44.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.903+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:23:44.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.915+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:23:44.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.931+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:44.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:23:44.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.983+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:23:44.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:44.988+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:45.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.035+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:45.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.052+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:23:45.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.054+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:45.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.065+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4f21a87:::benchmark_data_smithi171_44355_object4139:head, will try copies on 0,4 2024-04-20T02:23:45.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.079+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:23:45.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:45.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.111+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:23:45.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.112+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:45.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.149+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:23:45.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.174+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:23:45.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.178+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:23:45.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.190+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:45.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:23:45.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.225+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:23:45.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.256+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:23:45.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.261+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:23:45.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.279+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:45.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.298+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:45.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.333+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:23:45.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.347+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:23:45.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.376+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:45.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.385+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:45.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.393+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:45.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.412+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:23:45.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.453+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:23:45.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.462+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:45.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.476+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:23:45.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.499+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:45.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.522+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:23:45.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.533+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:23:45.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.539+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:23:45.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 249 16 3574223 3574207 897.037 848.875 0.000725983 0.00110028 2024-04-20T02:23:45.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.564+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:45.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.568+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:45.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.576+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:23:45.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.594+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:23:45.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.595+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:23:45.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.611+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:45.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.635+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:23:45.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.647+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:23:45.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.666+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:23:45.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.687+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:23:45.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:45.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.710+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:23:45.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.720+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:45.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.760+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:23:45.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.773+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:23:45.784 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.784+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:23:45.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.790+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:23:45.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.812+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:23:45.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.820+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:23:45.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.847+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:23:45.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.856+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:23:45.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.870+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:23:45.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.921+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:23:45.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.948+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:23:45.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.964+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:23:45.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:45.967+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:23:46.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.020+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:23:46.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.029+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:23:46.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.055+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:23:46.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.056+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:23:46.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.059+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:23:46.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.114+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:23:46.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.131+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:23:46.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.157+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:23:46.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.176+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:23:46.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.182+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:23:46.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:46.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.243+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:23:46.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.243+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:23:46.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.280+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:23:46.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.304+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:23:46.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.330+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:23:46.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:46.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.369+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:23:46.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.372+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:23:46.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.381+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:46.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.409+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:23:46.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.441+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:23:46.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:23:46.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.465+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:23:46.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.477+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:23:46.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.477+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:23:46.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.517+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:23:46.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.541+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:46.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 250 16 3588828 3588812 897.1 912.812 0.00186372 0.0011002 2024-04-20T02:23:46.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.557+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:23:46.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:46.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.593+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:23:46.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.605+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:23:46.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.609+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:23:46.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.624+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:23:46.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.628+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:46.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.655+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:23:46.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.708+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:23:46.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.711+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:23:46.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.749+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:23:46.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.754+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:23:46.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.760+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:23:46.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:23:46.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.826+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:23:46.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.848+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:23:46.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.868+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:23:46.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.870+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:23:46.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.919+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:46.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:23:46.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.932+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:23:46.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.940+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:46.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:46.963+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:23:47.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.013+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:23:47.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.034+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:23:47.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.046+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:23:47.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.064+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:47.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.067+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:23:47.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.086+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:23:47.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.105+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:23:47.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.110+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:47.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.121+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:23:47.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.143+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:23:47.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.146+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:23:47.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.147+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:23:47.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.181+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:23:47.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.202+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:23:47.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.203+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:47.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.236+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:23:47.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.244+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:23:47.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.259+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:23:47.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.266+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:47.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.284+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:23:47.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.308+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:23:47.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.314+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:23:47.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.339+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:23:47.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.348+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:23:47.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.349+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:23:47.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.376+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:23:47.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.399+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:23:47.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.405+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:23:47.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.417+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:23:47.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.453+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:47.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.455+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:23:47.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.464+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:23:47.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.482+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:23:47.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.491+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:23:47.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.511+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:47.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.518+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:23:47.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.544+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:23:47.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 251 16 3603338 3603322 897.138 906.875 0.00082629 0.00110016 2024-04-20T02:23:47.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.605+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:47.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.622+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:23:47.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.634+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:23:47.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.638+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:47.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.659+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:23:47.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.686+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:23:47.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.725+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:47.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.730+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:47.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.753+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:23:47.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.780+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:23:47.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.781+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:23:47.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.798+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:23:47.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.816+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:23:47.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.823+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:23:47.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.829+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:23:47.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.849+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:23:47.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:23:47.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:47.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.904+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:23:47.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.926+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:47.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.943+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:23:47.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.963+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:23:47.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:47.971+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:23:48.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.021+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:48.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.025+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:23:48.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.059+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:23:48.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.079+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:23:48.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.087+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:23:48.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.091+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:23:48.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.098+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:48.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.121+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:23:48.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.151+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:23:48.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.170+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:23:48.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.172+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:23:48.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.176+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:23:48.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:23:48.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.202+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:23:48.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.203+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:23:48.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.235+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:23:48.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.273+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:23:48.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:48.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:23:48.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.329+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:23:48.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.338+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:23:48.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.358+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:23:48.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.361+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:23:48.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.390+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:23:48.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.404+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:48.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.419+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:23:48.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:23:48.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.425+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:48.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:23:48.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.457+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:23:48.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.459+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:48.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.489+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:23:48.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.493+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:23:48.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.505+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:48.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.513+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:48.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 252 16 3617816 3617800 897.169 904.875 0.0011512 0.00110012 2024-04-20T02:23:48.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.548+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:23:48.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.554+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:23:48.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.568+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:48.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.580+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:23:48.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.599+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:23:48.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:23:48.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.610+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:48.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.639+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:23:48.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.653+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:23:48.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.664+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:23:48.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:23:48.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.689+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:23:48.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.710+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:48.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.721+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:23:48.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.724+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:48.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.758+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:23:48.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.773+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:23:48.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.806+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:48.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.827+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:23:48.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.845+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:23:48.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.848+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:23:48.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.859+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:23:48.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.860+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:48.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.899+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:23:48.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.911+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:48.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.939+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:23:48.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.941+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:23:48.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.978+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:23:48.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:48.983+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:23:49.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.016+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:49.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:23:49.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.039+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:23:49.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.055+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:23:49.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.068+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:23:49.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.098+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:23:49.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.100+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:23:49.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.112+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:49.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.149+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:49.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.157+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:23:49.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.167+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:23:49.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.179+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:23:49.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:23:49.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.210+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:23:49.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.219+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:23:49.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.253+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:23:49.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.287+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:23:49.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:23:49.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.318+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:23:49.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.341+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:49.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.345+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:49.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.370+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:49.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.406+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:23:49.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.406+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:49.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.424+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:23:49.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:23:49.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.455+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:23:49.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.455+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:23:49.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.470+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:49.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.477+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:23:49.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.485+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:23:49.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.517+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:49.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.530+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:23:49.547 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 253 16 3632220 3632204 897.181 900.25 0.00105606 0.00110011 2024-04-20T02:23:49.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.576+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:23:49.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.592+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:23:49.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.616+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:23:49.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.617+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:23:49.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.746+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:23:49.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.756+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:23:49.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.774+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:49.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.786+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:23:49.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:23:49.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.815+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:23:49.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.846+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:23:49.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.864+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:23:49.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.866+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:23:49.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.902+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:23:49.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.905+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:23:49.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.937+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:23:49.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.948+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:49.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.964+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:23:49.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:49.987+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:23:50.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.014+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:50.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.058+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:23:50.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.060+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:23:50.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.089+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:23:50.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.101+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:23:50.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.105+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:23:50.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.118+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:23:50.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.134+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:23:50.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.143+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:50.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:23:50.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.218+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:23:50.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.220+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:23:50.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.242+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:23:50.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:23:50.284 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.284+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:50.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.301+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:23:50.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.305+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:23:50.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.308+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:50.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.333+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:23:50.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.366+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:23:50.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.400+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:23:50.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.409+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:50.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.432+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:23:50.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.442+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:23:50.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.450+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:23:50.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.461+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:23:50.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.479+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:23:50.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.482+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:23:50.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.500+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:23:50.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.514+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:23:50.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.516+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:23:50.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.530+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:50.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 254 16 3645747 3645731 896.976 845.438 0.000694063 0.00110036 2024-04-20T02:23:50.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.551+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:23:50.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.563+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:23:50.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.601+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:23:50.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.624+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:23:50.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.635+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:50.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.643+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:23:50.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.657+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:23:50.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.671+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:50.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:23:50.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.735+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:23:50.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:23:50.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:23:50.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.796+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:23:50.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.796+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:23:50.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.805+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:23:50.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.811+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:23:50.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.840+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:23:50.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.856+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:23:50.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.872+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:23:50.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.928+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:23:50.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.930+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:23:50.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.957+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:23:50.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:50.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:50.991+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:23:51.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.001+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:23:51.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.007+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:23:51.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.012+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:23:51.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.023+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:23:51.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.043+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:23:51.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.072+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:23:51.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.088+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:23:51.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.100+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:23:51.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.116+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:23:51.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.134+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:23:51.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.144+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:23:51.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.159+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:23:51.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.177+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:23:51.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.204+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:23:51.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.207+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:23:51.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:23:51.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.254+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:23:51.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.304+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:51.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.305+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:23:51.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.326+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:51.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:23:51.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:23:51.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.388+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:23:51.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.413+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:23:51.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.423+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:23:51.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.443+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:23:51.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:23:51.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.471+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:23:51.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.493+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:23:51.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.505+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:23:51.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 255 16 3660386 3660370 897.047 914.938 0.000613413 0.00110027 2024-04-20T02:23:51.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.555+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:23:51.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:23:51.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.579+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:23:51.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.594+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:23:51.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.617+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:23:51.629 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.629+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:23:51.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.660+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:51.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.671+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:23:51.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.701+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:23:51.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.713+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:51.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.719+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:51.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.737+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:51.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.743+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:23:51.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.761+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:23:51.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.777+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:23:51.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.790+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:23:51.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.791+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:23:51.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.810+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:23:51.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.826+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:51.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.847+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:23:51.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.848+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:23:51.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.860+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:23:51.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.878+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:23:51.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.918+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:51.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.951+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:23:51.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:23:51.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:51.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:52.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.001+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:23:52.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.004+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:23:52.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.038+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:23:52.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.041+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:23:52.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.060+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:52.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.061+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:23:52.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.070+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:23:52.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.091+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:23:52.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:23:52.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.120+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:52.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.132+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:52.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.139+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:23:52.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.169+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:23:52.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.169+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:23:52.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:52.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.202+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:23:52.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.224+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:23:52.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.253+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:23:52.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.259+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:23:52.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:23:52.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:23:52.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.296+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:23:52.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.302+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:23:52.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.313+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:23:52.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.335+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:23:52.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.336+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:23:52.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.338+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:52.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:52.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.364+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:52.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.408+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:23:52.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.424+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:23:52.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.435+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:23:52.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.451+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:23:52.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.459+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:23:52.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.483+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:23:52.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.504+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:23:52.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.511+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:23:52.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:23:52.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 256 16 3674832 3674816 897.069 902.875 0.000702442 0.00110024 2024-04-20T02:23:52.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.549+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:23:52.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.551+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:23:52.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.572+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:23:52.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:23:52.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:23:52.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.652+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:23:52.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.664+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:23:52.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.670+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:23:52.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.687+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:52.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.701+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:23:52.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.707+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:23:52.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.713+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:23:52.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.724+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:23:52.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.747+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:23:52.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.775+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:23:52.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.787+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:23:52.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.842+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:23:52.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.903+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:23:52.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.934+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:23:52.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.949+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:23:52.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.956+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:23:52.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.968+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:23:52.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:52.978+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:23:53.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.001+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:53.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.006+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:23:53.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.036+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:53.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.060+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:23:53.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.083+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:23:53.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.097+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:23:53.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.100+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:23:53.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.129+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:23:53.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.131+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:23:53.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.136+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:23:53.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.159+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:23:53.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.172+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:23:53.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:23:53.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.260+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:23:53.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:23:53.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.288+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:23:53.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.308+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:23:53.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.310+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:23:53.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.353+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:23:53.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.357+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:23:53.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:23:53.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.408+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:53.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.422+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:23:53.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.443+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:23:53.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.479+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:53.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.486+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:23:53.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.489+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:23:53.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.507+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:23:53.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.529+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:23:53.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.532+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:23:53.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 257 16 3689233 3689217 897.08 900.062 0.0158688 0.00110023 2024-04-20T02:23:53.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.560+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:53.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:23:53.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.577+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:23:53.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.596+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:23:53.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:23:53.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.625+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:23:53.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.643+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:23:53.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.661+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:23:53.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.683+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:23:53.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.719+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:53.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:23:53.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:23:53.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.759+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:23:53.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.779+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:23:53.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.779+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:23:53.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.780+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:23:53.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.799+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:23:53.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.806+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:23:53.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.841+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:23:53.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.850+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:23:53.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.875+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:23:53.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.881+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:23:53.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.889+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:23:53.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.896+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:23:53.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.904+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:23:53.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.943+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:23:53.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.945+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:23:53.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.952+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:23:53.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.974+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:53.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:53.980+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:23:54.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.018+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:23:54.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.020+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:23:54.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.028+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:23:54.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.061+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:23:54.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.082+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:23:54.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.088+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:23:54.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.107+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:23:54.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.116+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:23:54.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.125+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:54.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.143+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:23:54.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.164+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:23:54.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.166+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:23:54.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.169+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:23:54.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.181+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:23:54.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.195+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:23:54.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.214+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:23:54.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.261+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:23:54.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.265+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:23:54.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.272+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:23:54.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.294+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:23:54.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.306+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:23:54.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.310+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:23:54.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:23:54.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.341+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:23:54.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.368+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:23:54.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.384+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:23:54.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.398+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:23:54.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.401+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:23:54.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:23:54.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:23:54.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.463+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:23:54.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.479+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:23:54.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.496+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:23:54.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.505+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:23:54.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.507+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:23:54.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.523+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:54.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.527+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:23:54.532 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.532+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:23:54.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.547+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:23:54.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 258 16 3703677 3703661 897.101 902.75 0.000965095 0.0011002 2024-04-20T02:23:54.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:23:54.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.594+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:23:54.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.622+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:23:54.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.623+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:23:54.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.641+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:23:54.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.653+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:23:54.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.660+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:23:54.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.710+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:23:54.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.744+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:23:54.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.749+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:23:54.783 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.783+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:23:54.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.791+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:54.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.803+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:23:54.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.820+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:54.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.835+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:23:54.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.837+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:23:54.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.844+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:54.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.856+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:23:54.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.880+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:23:54.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.892+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:23:54.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:23:54.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.896+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:23:54.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.919+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:23:54.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.924+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:54.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:54.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.943+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:23:54.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.954+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:23:54.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:54.963+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:23:55.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.020+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:23:55.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.048+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:23:55.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.097+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:23:55.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.113+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:23:55.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:23:55.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.163+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:23:55.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.205+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:23:55.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.237+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:23:55.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.241+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:23:55.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.264+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:23:55.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.274+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:23:55.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.304+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:23:55.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.307+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:23:55.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.338+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:23:55.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.339+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:23:55.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:23:55.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.362+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:23:55.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.384+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:23:55.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.400+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:23:55.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.416+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:23:55.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.447+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:23:55.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.464+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:23:55.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.486+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:23:55.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.487+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:23:55.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.492+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:23:55.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:55.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 259 16 3717798 3717782 897.045 882.562 0.00087261 0.00110028 2024-04-20T02:23:55.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.554+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:23:55.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:23:55.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.582+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:23:55.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.598+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:23:55.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.603+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:23:55.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.624+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:23:55.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.627+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:23:55.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.643+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:23:55.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.654+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:23:55.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.675+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:23:55.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.684+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:23:55.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.693+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:23:55.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.696+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:23:55.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.773+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:23:55.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.794+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:23:55.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.823+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:23:55.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.829+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:55.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.905+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:23:55.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:23:55.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:55.942+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:23:56.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.000+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:23:56.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.026+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:23:56.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.107+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:56.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.138+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:23:56.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.168+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:23:56.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.196+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:23:56.199 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.199+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:23:56.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.220+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:23:56.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.234+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:23:56.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.260+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:23:56.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.303+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:23:56.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.325+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:23:56.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.358+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:56.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.361+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:23:56.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.372+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:56.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.381+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:23:56.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.418+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:23:56.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.436+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:23:56.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.490+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:23:56.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.491+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:23:56.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.513+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:23:56.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:23:56.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.539+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:23:56.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.542+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:23:56.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:23:56.549798+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00110007 2024-04-20T02:23:56.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:23:56.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 260 16 3732826 3732810 897.207 939.25 0.000800171 0.00110007 2024-04-20T02:23:56.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.559+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:23:56.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.571+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:23:56.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.578+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:23:56.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.594+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:23:56.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.605+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:23:56.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.608+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:23:56.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.645+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:23:56.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.661+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:23:56.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.691+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:23:56.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.716+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:23:56.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.727+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:23:56.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.742+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:23:56.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.763+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:23:56.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.795+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:56.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:23:56.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.811+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:56.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.836+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:23:56.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.855+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:23:56.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.864+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:23:56.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.869+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:23:56.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.888+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:56.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:23:56.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:23:56.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.945+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:23:56.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.971+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:23:56.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:56.992+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:23:57.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:23:57.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.028+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:23:57.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.035+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:23:57.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.092+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:23:57.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.113+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:23:57.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:23:57.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.139+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:23:57.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.155+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:23:57.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.157+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:23:57.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.197+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:23:57.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.213+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:23:57.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.240+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:23:57.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.249+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:23:57.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.270+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:23:57.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.303+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:23:57.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.307+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:23:57.333 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.333+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:23:57.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.344+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:23:57.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.359+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:23:57.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.372+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:23:57.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.373+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:57.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.412+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:23:57.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.423+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:23:57.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.428+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:23:57.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.462+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:23:57.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.477+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:23:57.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.489+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:23:57.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 261 15 3746874 3746859 897.133 878.062 0.000958926 0.00110014 2024-04-20T02:23:57.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.548+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:23:57.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.552+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:23:57.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.552+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:23:57.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.576+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:23:57.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.603+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:23:57.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.612+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:23:57.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.623+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:23:57.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:23:57.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.654+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:23:57.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.666+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:23:57.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.671+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:23:57.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.677+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:23:57.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.710+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:23:57.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.725+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:23:57.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.725+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:23:57.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.753+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:57.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.755+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:23:57.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.785+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:23:57.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.789+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:23:57.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.796+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:23:57.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.810+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:23:57.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.817+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:57.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.832+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:23:57.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.834+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:23:57.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.857+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:23:57.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.870+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:23:57.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.881+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:23:57.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.911+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:23:57.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.917+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:23:57.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.929+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:23:57.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.942+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:23:57.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.949+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:23:57.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.957+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:23:57.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.972+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:23:57.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.987+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:23:57.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:57.987+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:23:58.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.032+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:23:58.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.052+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:23:58.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.079+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:23:58.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.092+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:23:58.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.103+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:23:58.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.111+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:23:58.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.142+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:23:58.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.177+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:23:58.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.188+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:23:58.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.207+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:23:58.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:23:58.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.230+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:23:58.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.241+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:23:58.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.248+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:23:58.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.253+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:23:58.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.291+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:23:58.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.297+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:23:58.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:23:58.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.332+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:23:58.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:23:58.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:23:58.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.397+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:23:58.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.420+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:23:58.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.438+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:23:58.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.443+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:23:58.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.460+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:23:58.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.466+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:23:58.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.497+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:23:58.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:23:58.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.533+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:23:58.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.537+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:23:58.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.540+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:23:58.548 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 262 16 3761371 3761355 897.166 906 0.000841415 0.00110012 2024-04-20T02:23:58.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.556+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:23:58.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.579+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:23:58.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.592+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:23:58.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.625+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:23:58.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.647+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:23:58.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.691+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:23:58.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.693+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:23:58.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.719+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:23:58.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.733+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:23:58.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.750+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:58.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.796+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:23:58.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.802+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:23:58.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.815+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:23:58.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.842+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:23:58.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:23:58.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.863+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:23:58.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.876+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:23:58.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:23:58.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.899+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:23:58.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.920+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:23:58.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:58.938+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:23:59.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.005+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:23:59.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.006+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:23:59.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.025+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:23:59.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.037+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:23:59.050 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.050+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:23:59.064 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.064+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:23:59.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.090+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:23:59.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.104+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:23:59.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.118+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:23:59.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.145+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:23:59.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.152+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:23:59.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.163+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:23:59.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.172+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:23:59.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.190+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:23:59.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.204+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:23:59.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.213+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:23:59.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.228+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:23:59.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:23:59.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.292+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:23:59.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.300+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:23:59.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.320+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:23:59.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.338+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:23:59.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.342+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:23:59.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.412+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:23:59.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.427+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:23:59.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.428+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:23:59.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.437+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:23:59.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.452+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:23:59.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.467+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:23:59.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.477+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:23:59.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.518+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:23:59.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.547+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:23:59.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 263 15 3776243 3776228 897.289 929.562 0.000731657 0.00109997 2024-04-20T02:23:59.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.567+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:23:59.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.580+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:23:59.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.584+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:23:59.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.598+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:23:59.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.637+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:23:59.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.704+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:23:59.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.712+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:23:59.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.742+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:23:59.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.745+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:23:59.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.764+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:23:59.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.792+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:23:59.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.805+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:23:59.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.820+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:23:59.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.848+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:23:59.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.894+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:23:59.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.913+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:23:59.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.929+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:23:59.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.941+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:23:59.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.941+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:23:59.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.956+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:23:59.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.969+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:23:59.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.981+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:23:59.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:23:59.992+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:00.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:24:00.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.033+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:24:00.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.036+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:24:00.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:24:00.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.067+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:24:00.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.078+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:00.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.112+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:24:00.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.114+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:00.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.130+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:24:00.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.163+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:24:00.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.165+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:24:00.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.168+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:24:00.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.202+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:24:00.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.211+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:24:00.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.227+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:24:00.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.276+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:24:00.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.282+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:00.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.288+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:00.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.306+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:24:00.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.340+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:24:00.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.348+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:24:00.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.352+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:24:00.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:24:00.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.383+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:24:00.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.417+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:00.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.429+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:24:00.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.447+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:00.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.449+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:24:00.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.462+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:24:00.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.485+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:24:00.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.518+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:24:00.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.524+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:24:00.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 264 16 3791106 3791090 897.409 928.875 0.00113481 0.00109982 2024-04-20T02:24:00.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.554+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:24:00.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.554+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:24:00.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.567+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:24:00.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:00.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.624+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:24:00.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.630+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:24:00.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.636+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:24:00.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.676+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:24:00.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.695+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:24:00.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.704+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:00.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.713+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:24:00.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.740+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:24:00.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.753+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:24:00.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.764+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:24:00.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.787+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:00.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.800+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:24:00.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.801+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:24:00.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.838+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:24:00.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.846+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:24:00.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.851+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:24:00.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.875+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:00.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.895+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:24:00.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.917+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:24:00.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.922+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:00.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.942+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:24:00.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:24:00.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.967+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:24:00.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:00.978+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:24:01.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.007+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:24:01.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.033+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:24:01.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.042+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:24:01.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.066+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:01.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.077+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:24:01.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.097+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:24:01.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.113+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:24:01.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:24:01.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.137+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:24:01.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.152+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:24:01.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.178+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:24:01.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.197+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:24:01.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.202+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:01.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.223+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:24:01.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.225+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:01.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.247+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:24:01.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.251+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:24:01.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.264+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:01.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.309+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:24:01.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.321+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:24:01.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.341+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:24:01.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.344+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:24:01.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.361+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:24:01.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.362+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:24:01.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.380+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:24:01.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.417+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:24:01.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.417+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:24:01.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.421+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:24:01.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.442+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:24:01.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.454+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:24:01.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.477+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:24:01.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.488+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:24:01.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.496+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:01.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.511+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:01.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:24:01.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.528+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:24:01.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.543+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:01.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.547+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:24:01.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 265 16 3805603 3805587 897.441 906.062 0.000715963 0.00109978 2024-04-20T02:24:01.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.580+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:24:01.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.591+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:24:01.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.616+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:24:01.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.617+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:24:01.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.620+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:01.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.630+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:01.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.652+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:24:01.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.661+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:24:01.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.670+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:24:01.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.681+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:24:01.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.701+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:24:01.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.712+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:24:01.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.727+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:24:01.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.763+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:01.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.793+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:01.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.794+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:01.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.820+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:01.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.850+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:24:01.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.869+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:01.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.878+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:01.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.882+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:24:01.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.911+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:24:01.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.925+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:24:01.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.930+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:24:01.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.939+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:24:01.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.957+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:01.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.963+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:01.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:01.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:24:02.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.002+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:02.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.023+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:24:02.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.027+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:24:02.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.031+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:24:02.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.083+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:24:02.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.084+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:24:02.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:24:02.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:24:02.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:24:02.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.149+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:24:02.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.157+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:24:02.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.176+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:24:02.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.178+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:24:02.240 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.240+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:24:02.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.256+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:02.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.297+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:24:02.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.304+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:24:02.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.312+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:24:02.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.318+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:24:02.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.349+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:02.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.355+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:02.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.380+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:02.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.405+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:24:02.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.406+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:24:02.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.445+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:24:02.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:02.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.466+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:24:02.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.485+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:24:02.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.498+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:24:02.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.507+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:02.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.510+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:02.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.511+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:24:02.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.525+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:24:02.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 266 16 3820286 3820270 897.517 917.688 0.000710439 0.00109968 2024-04-20T02:24:02.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.553+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:24:02.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.570+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:24:02.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.576+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:24:02.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.599+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:24:02.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.604+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:02.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.622+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:24:02.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.622+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:24:02.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.626+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:24:02.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.648+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:24:02.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.668+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5c04ad5:::benchmark_data_smithi171_44355_object541:head, will try copies on 2,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.723+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.726+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.747+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.748+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.810+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.822+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.866+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.890+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.894+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.920+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:02.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.930+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:24:02.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.943+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:24:02.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.945+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:24:02.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.978+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:24:02.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:02.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:02.993+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:24:03.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.005+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:24:03.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.006+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:24:03.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:03.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.049+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:03.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.065+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:24:03.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.065+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:03.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.090+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:24:03.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.098+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:03.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.103+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:24:03.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.119+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:24:03.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.142+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:03.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.154+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:24:03.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.163+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:24:03.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.187+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:24:03.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.196+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:03.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.202+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:24:03.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:03.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.253+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:24:03.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.274+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:24:03.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.289+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:24:03.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.289+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:24:03.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.314+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:24:03.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.317+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:24:03.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.317+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:03.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.355+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:24:03.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.370+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:24:03.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.408+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:03.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.415+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:24:03.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.417+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:03.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.449+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:03.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.470+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:24:03.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.480+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:03.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.523+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:03.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.538+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:24:03.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 267 16 3835014 3834998 897.603 920.5 0.000787913 0.00109958 2024-04-20T02:24:03.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.553+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:24:03.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.558+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:24:03.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:03.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:24:03.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:24:03.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.624+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:24:03.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.630+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:03.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.644+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:24:03.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.660+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:24:03.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.667+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:03.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.674+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:03.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.700+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:24:03.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.722+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:24:03.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.729+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:24:03.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.761+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:24:03.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.764+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:03.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:24:03.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:03.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.829+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:24:03.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.830+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:24:03.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.852+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:24:03.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.866+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:24:03.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.866+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:24:03.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.883+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:03.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.893+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:24:03.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:24:03.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.924+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:24:03.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.943+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:24:03.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.965+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:24:03.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.981+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:24:03.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:03.981+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:24:04.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.003+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:24:04.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.041+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:04.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.055+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:04.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.069+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:24:04.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.074+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:24:04.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.113+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:24:04.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.146+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:24:04.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.147+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:04.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:04.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.182+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:24:04.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.190+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:24:04.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.210+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:24:04.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.222+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:04.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.233+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:24:04.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.262+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:24:04.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:24:04.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.272+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:24:04.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.286+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:24:04.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.331+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:24:04.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:24:04.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.386+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:24:04.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.397+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:24:04.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.399+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:24:04.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.431+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:24:04.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.432+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:24:04.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.451+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:24:04.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.467+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:24:04.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.468+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:24:04.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.507+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:24:04.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.508+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:24:04.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.522+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:24:04.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 268 16 3849422 3849406 897.613 900.5 0.000679059 0.00109957 2024-04-20T02:24:04.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.565+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:24:04.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.573+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:04.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.577+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:24:04.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:24:04.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:24:04.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.625+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:24:04.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.658+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:24:04.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.661+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:24:04.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.673+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:24:04.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.675+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:24:04.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:24:04.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.709+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:24:04.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.720+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:24:04.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:24:04.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.766+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:24:04.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.775+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:04.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.788+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:04.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.794+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:24:04.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.805+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:04.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:04.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.842+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:24:04.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.860+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:24:04.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.878+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:24:04.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:04.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.917+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:24:04.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.945+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:24:04.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.945+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:24:04.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.955+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:24:04.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.973+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:24:04.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:04.976+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:24:05.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.035+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:24:05.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.039+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:24:05.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.059+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:24:05.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.078+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:24:05.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.109+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:24:05.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.115+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:05.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.121+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:24:05.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.144+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:24:05.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.160+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:05.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.208+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:05.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.258+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:05.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.289+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:05.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.298+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:24:05.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:24:05.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.332+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:24:05.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:24:05.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.354+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:24:05.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.369+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:05.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.400+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:05.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.431+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:24:05.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.445+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:24:05.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.469+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:24:05.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.481+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:24:05.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.484+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:24:05.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.497+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:24:05.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.522+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:24:05.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.524+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:24:05.549 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 269 15 3863980 3863965 897.658 909.938 0.000811153 0.00109951 2024-04-20T02:24:05.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.554+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:05.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.586+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:24:05.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.592+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:24:05.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:24:05.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.630+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:24:05.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.636+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:24:05.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.650+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:24:05.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.652+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:05.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.661+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:05.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.665+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:05.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:05.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.719+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:24:05.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.738+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:24:05.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.747+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:24:05.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.766+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:24:05.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.772+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:24:05.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.801+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:24:05.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.802+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:24:05.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.842+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:24:05.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.863+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:05.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.866+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:24:05.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.888+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:24:05.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:24:05.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.917+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:05.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.940+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:24:05.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.952+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:05.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.962+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:24:05.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:24:05.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.992+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:24:05.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:05.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:24:06.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.016+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:24:06.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.035+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:24:06.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.041+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:24:06.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.066+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:06.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:24:06.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.092+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:24:06.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.093+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:24:06.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.127+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:24:06.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.140+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:06.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:24:06.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.186+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:24:06.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.187+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:24:06.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.190+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:24:06.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.214+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:24:06.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.245+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:06.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.274+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:24:06.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:06.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.331+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:24:06.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.372+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:24:06.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.374+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:24:06.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.407+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:24:06.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.407+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:24:06.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:24:06.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.455+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:24:06.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.512+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:06.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:24:06.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.536+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:24:06.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 270 16 3878270 3878254 897.641 893.062 0.00182101 0.00109953 2024-04-20T02:24:06.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.583+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:24:06.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.611+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:24:06.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.618+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:24:06.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.649+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:24:06.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.655+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:24:06.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.669+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:24:06.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.677+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:06.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.726+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:06.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.735+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:06.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.739+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:06.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.763+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:24:06.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.768+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:24:06.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:24:06.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.814+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:24:06.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.834+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:06.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.840+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:24:06.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.875+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:24:06.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.880+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:24:06.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.884+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:24:06.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.900+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:24:06.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.922+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:24:06.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.942+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:06.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.962+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:24:06.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.977+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:24:06.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.979+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:24:06.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.996+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:24:06.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:06.997+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:07.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.022+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:24:07.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.047+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:24:07.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.058+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:07.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.059+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:24:07.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.103+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:24:07.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.115+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:24:07.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.159+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:24:07.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.179+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:24:07.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.213+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:07.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.234+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:24:07.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.297+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:24:07.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.306+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:24:07.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.336+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:07.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.353+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:24:07.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.395+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:24:07.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.402+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:07.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:24:07.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.471+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:24:07.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.474+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:24:07.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.497+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:24:07.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.497+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:07.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.542+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:07.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 271 16 3892757 3892741 897.669 905.438 0.000781172 0.00109949 2024-04-20T02:24:07.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.562+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:07.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.584+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:24:07.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.591+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:07.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.600+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:24:07.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.628+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:24:07.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.637+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:24:07.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.647+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:24:07.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.665+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:24:07.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.679+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:24:07.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.689+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:24:07.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.692+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:24:07.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.704+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:24:07.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:07.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.744+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:24:07.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.759+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:24:07.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.775+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:24:07.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:24:07.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.814+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:24:07.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.850+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:24:07.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.865+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:07.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.896+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:24:07.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:07.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.938+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:24:07.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.947+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:24:07.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.966+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:24:07.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.978+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:24:07.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:07.991+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:24:08.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.010+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:24:08.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.013+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:24:08.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.030+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:08.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.042+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:08.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.066+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:24:08.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.072+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:24:08.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:24:08.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:24:08.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.104+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:08.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.112+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:24:08.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.129+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:24:08.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.130+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:24:08.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.170+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:24:08.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.171+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:24:08.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.178+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:24:08.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.216+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:08.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.217+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:24:08.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.221+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:24:08.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.232+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:24:08.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.263+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:24:08.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.269+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:24:08.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.300+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:08.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.313+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:24:08.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.323+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:24:08.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:24:08.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.372+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:08.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.380+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:24:08.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.404+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:24:08.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.404+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:24:08.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:24:08.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.441+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:24:08.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.474+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:08.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.504+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:24:08.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.507+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:08.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.540+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:24:08.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 272 16 3907008 3906992 897.643 890.688 0.00159776 0.00109952 2024-04-20T02:24:08.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.574+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:24:08.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.589+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:24:08.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.613+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:24:08.621 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.620+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:24:08.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.630+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:24:08.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.655+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:24:08.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.678+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:24:08.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:24:08.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.688+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:08.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.727+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:24:08.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.739+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:24:08.757 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.756+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:24:08.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.769+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:24:08.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.798+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:24:08.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.800+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:24:08.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.823+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:24:08.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.859+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:24:08.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.900+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:24:08.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.907+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:08.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.923+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:24:08.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.982+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:24:08.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.985+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:08.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:08.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:24:09.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.015+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:24:09.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.020+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:24:09.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.022+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:24:09.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.035+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:24:09.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.100+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:09.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.111+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:24:09.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.127+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:24:09.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.147+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:09.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.153+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:24:09.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.160+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:24:09.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.179+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:24:09.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:24:09.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.236+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:24:09.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.258+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:24:09.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.276+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:09.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.280+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:09.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.288+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:24:09.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.316+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:24:09.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.320+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:24:09.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.336+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:24:09.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.363+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:24:09.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.385+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:09.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.385+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:24:09.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:24:09.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.447+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:24:09.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.449+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:24:09.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.472+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:24:09.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.491+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:09.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.502+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:09.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.515+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:24:09.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.522+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:24:09.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 273 16 3921552 3921536 897.684 909 0.000830224 0.00109948 2024-04-20T02:24:09.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.554+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:24:09.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.579+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:24:09.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.613+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:24:09.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.624+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:09.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.630+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:24:09.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.637+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:24:09.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.657+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:24:09.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:24:09.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.681+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:24:09.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.694+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:24:09.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.806+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:24:09.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.862+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:09.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.886+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:24:09.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.903+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:24:09.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.910+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:24:09.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:09.992+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:10.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.009+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:10.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.017+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:24:10.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.110+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:24:10.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.127+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:24:10.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.145+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:24:10.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.154+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:24:10.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.174+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:24:10.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.191+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:24:10.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.195+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:24:10.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.212+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:24:10.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.220+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:24:10.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.239+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:24:10.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.277+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:10.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.280+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:24:10.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.288+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:10.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.335+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:24:10.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.350+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:24:10.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.351+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:24:10.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.355+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:10.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.379+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:24:10.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.435+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:24:10.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.446+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:24:10.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.469+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:24:10.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.501+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:24:10.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.502+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:24:10.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:24:10.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 274 16 3934380 3934364 897.334 801.75 0.000920789 0.00109991 2024-04-20T02:24:10.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.554+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:24:10.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.555+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:24:10.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.580+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:24:10.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.592+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:24:10.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.609+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:10.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.612+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:24:10.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.622+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:10.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.655+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:24:10.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.658+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:24:10.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.677+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:24:10.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.687+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:10.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.721+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:24:10.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.722+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:24:10.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.736+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:10.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.768+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:24:10.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.795+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:24:10.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.805+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:24:10.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:24:10.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.840+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:24:10.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.860+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:24:10.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:10.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.916+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:10.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.939+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:24:10.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.962+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:24:10.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.980+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:24:10.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:10.987+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:24:11.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.029+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:11.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.049+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:24:11.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.062+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:24:11.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.081+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:24:11.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.089+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:11.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.120+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:24:11.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.125+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:24:11.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.167+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:24:11.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.181+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:11.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.217+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:24:11.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.224+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:24:11.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.247+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:24:11.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.270+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:11.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.273+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:24:11.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.273+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:24:11.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.311+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:24:11.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:24:11.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.327+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:24:11.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.368+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:24:11.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.374+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:24:11.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:24:11.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.414+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:24:11.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.415+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:24:11.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.435+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:11.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.437+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:24:11.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.447+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:24:11.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.478+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:11.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.531+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:24:11.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 275 16 3948850 3948834 897.359 904.375 0.00074155 0.00109988 2024-04-20T02:24:11.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.563+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:24:11.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.583+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:11.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:24:11.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.608+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:24:11.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.620+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:11.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.656+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:24:11.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.664+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:11.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.672+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:11.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.702+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:24:11.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.707+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:24:11.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.711+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:24:11.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.745+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:11.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.764+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:11.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.777+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:11.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.791+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:24:11.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.794+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:11.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.809+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:11.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.838+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:24:11.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.845+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:24:11.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.864+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:24:11.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.871+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:11.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.897+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:24:11.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:24:11.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.922+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:24:11.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.931+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:24:11.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.950+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:24:11.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.985+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:24:11.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.995+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:24:11.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:11.999+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:24:12.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.022+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:24:12.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.026+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:24:12.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.039+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:12.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.056+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:24:12.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.088+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:24:12.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.093+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:24:12.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.113+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:12.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.128+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:24:12.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.150+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:24:12.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.152+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:12.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.189+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:24:12.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.214+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:24:12.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.230+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:24:12.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.231+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:24:12.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.253+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:24:12.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.267+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:24:12.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.267+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:24:12.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.291+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:24:12.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.291+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:12.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.326+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:24:12.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.342+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:24:12.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:12.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.359+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:24:12.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.370+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:24:12.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.373+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:24:12.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.412+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:24:12.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.434+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:12.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.455+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:24:12.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.459+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:24:12.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.497+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:24:12.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.517+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:12.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.523+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:24:12.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.523+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:24:12.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 276 16 3963054 3963038 897.324 887.75 0.000752363 0.00109992 2024-04-20T02:24:12.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.557+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:12.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.570+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:24:12.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.582+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:24:12.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.583+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:24:12.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.592+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:24:12.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.593+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:24:12.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.643+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:24:12.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.658+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:24:12.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.693+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:24:12.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.695+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:24:12.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.727+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:24:12.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.761+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:24:12.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:24:12.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.855+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:24:12.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.877+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:12.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.892+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:24:12.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.933+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:24:12.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.941+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:24:12.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.965+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:12.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.975+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:24:12.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.978+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:24:12.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:12.980+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:24:13.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.018+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:13.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.035+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:24:13.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.064+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:24:13.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.075+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:24:13.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.089+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:13.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.094+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:24:13.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.141+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:24:13.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:24:13.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.152+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:24:13.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.168+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:13.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.192+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:24:13.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.210+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:24:13.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.234+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:13.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.250+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:24:13.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.273+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:13.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.280+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:24:13.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.312+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:13.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.318+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:13.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:24:13.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.345+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:24:13.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.374+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:24:13.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:24:13.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.408+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:24:13.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.429+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:24:13.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:24:13.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.454+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:24:13.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.461+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:13.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.482+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:24:13.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.485+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:13.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.487+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:24:13.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.502+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:13.504 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.504+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:24:13.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.516+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:24:13.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.534+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:24:13.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.544+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:24:13.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 277 16 3976652 3976636 897.152 849.875 0.000506756 0.00110013 2024-04-20T02:24:13.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.555+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:24:13.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.575+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:13.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.605+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:13.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.608+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:24:13.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.615+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:24:13.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.631+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:24:13.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.675+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:24:13.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.750+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:24:13.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.760+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:24:13.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.776+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:13.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.795+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:24:13.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.807+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:24:13.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.824+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:13.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:24:13.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.858+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:24:13.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.967+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:24:13.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.996+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:13.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:13.998+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:14.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.025+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:24:14.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.038+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:24:14.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.043+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:14.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.052+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:14.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.055+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:24:14.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:14.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.091+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:24:14.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.106+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:24:14.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.110+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:24:14.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.119+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:24:14.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.135+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:24:14.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.145+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:24:14.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.156+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:14.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a770141e:::benchmark_data_smithi171_44355_object4366:head, will try copies on 0,4 2024-04-20T02:24:14.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.179+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:24:14.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.212+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:24:14.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.216+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:14.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.260+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:24:14.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.302+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:14.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.314+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:24:14.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.317+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:24:14.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.345+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:24:14.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.371+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:14.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.384+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:24:14.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.389+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:14.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.403+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:24:14.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.425+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:24:14.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.446+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:24:14.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.464+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:14.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.465+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:24:14.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.469+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:24:14.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.478+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:24:14.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.492+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:14.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.520+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:14.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.535+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:24:14.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.539+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:24:14.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 278 16 3990718 3990702 897.087 879.125 0.0010252 0.00110021 2024-04-20T02:24:14.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.563+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:14.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.586+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:24:14.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.587+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:24:14.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.643+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:24:14.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.661+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:14.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.692+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:14.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.712+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:24:14.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.737+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:24:14.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.750+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:14.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.759+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:24:14.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.765+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:14.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.789+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:14.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.799+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:24:14.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.812+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:24:14.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.845+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:24:14.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:14.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:24:14.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:14.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.942+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:24:14.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.977+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:24:14.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:14.990+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:15.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.003+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:15.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.019+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:24:15.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.045+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:24:15.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.056+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:24:15.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:24:15.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.085+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:24:15.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.102+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:24:15.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.115+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:15.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:24:15.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.135+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:24:15.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.154+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:24:15.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.166+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:24:15.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.171+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:15.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.199+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:24:15.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.228+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:24:15.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:15.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.269+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:15.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.269+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:24:15.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.291+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:24:15.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.310+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:24:15.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:24:15.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.353+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:24:15.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.363+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:15.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.369+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:24:15.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.447+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:24:15.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.451+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:24:15.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.468+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:24:15.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:15.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.525+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:24:15.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.540+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:24:15.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.546+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:24:15.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 279 15 4005409 4005394 897.163 918.25 0.00113035 0.00110012 2024-04-20T02:24:15.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.551+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:24:15.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.576+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:24:15.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.585+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:24:15.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.600+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:24:15.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.623+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:24:15.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.630+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:24:15.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:24:15.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.732+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:24:15.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.753+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:24:15.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.759+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:24:15.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.832+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:24:15.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.857+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:24:15.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:24:15.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.900+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:24:15.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.914+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:24:15.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.949+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:15.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.974+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:24:15.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:15.981+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:24:16.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.002+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:16.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.033+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:16.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.072+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:24:16.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.073+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:24:16.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.073+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:24:16.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.135+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:24:16.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.149+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:24:16.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.151+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:24:16.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.157+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:24:16.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.181+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:24:16.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.225+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:16.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.231+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:24:16.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.236+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:24:16.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.271+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:24:16.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.281+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:16.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.302+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:24:16.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.311+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:24:16.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.329+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:24:16.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.337+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:24:16.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.346+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:24:16.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.362+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:16.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.363+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:24:16.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:24:16.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.405+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:24:16.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.407+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:16.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.434+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:24:16.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.451+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:24:16.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.517+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:16.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:24:16.550 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:24:16.551897+0000 min lat: 0.000210708 max lat: 0.138714 avg lat: 0.00109995 2024-04-20T02:24:16.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:24:16.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 280 16 4020372 4020356 897.298 935.125 0.00262667 0.00109995 2024-04-20T02:24:16.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.551+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:24:16.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:24:16.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.580+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:24:16.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.609+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:24:16.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.612+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:16.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.613+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:24:16.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.665+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:24:16.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.688+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:24:16.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.709+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:24:16.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:24:16.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.731+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:24:16.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.739+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:16.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:24:16.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.774+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:24:16.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:24:16.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.817+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:24:16.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.838+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:24:16.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:24:16.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.856+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:24:16.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.887+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:24:16.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.896+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:16.920 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.919+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:24:16.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.963+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:16.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.974+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:24:16.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.982+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:24:16.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:16.999+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:24:17.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.033+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:24:17.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.045+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:24:17.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.049+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:24:17.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.059+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:24:17.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.092+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:17.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.100+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:17.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:17.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.120+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:24:17.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.129+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:24:17.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.137+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:24:17.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.169+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:24:17.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.181+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:24:17.215 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.215+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:17.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.234+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:24:17.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:17.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.252+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:24:17.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.271+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:24:17.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.290+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:17.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.297+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:24:17.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.308+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:24:17.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.321+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:17.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.344+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:24:17.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.353+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:24:17.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.379+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:24:17.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.401+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:17.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.429+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:17.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.430+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:17.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.447+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:24:17.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.469+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:17.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.489+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:24:17.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.492+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:24:17.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.534+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:24:17.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 281 16 4035083 4035067 897.377 919.438 0.000701584 0.00109986 2024-04-20T02:24:17.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:17.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:17.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:24:17.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.601+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:24:17.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.621+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:24:17.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.686+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:24:17.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.732+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:24:17.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.739+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:17.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.746+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:17.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.753+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:24:17.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.768+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:24:17.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:17.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.796+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:24:17.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.809+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:24:17.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.831+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:24:17.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.834+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:17.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.850+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:17.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.862+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:17.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.873+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:24:17.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.893+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:17.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.894+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:17.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.927+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:24:17.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.953+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:24:17.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:24:17.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:24:17.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:17.995+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:18.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.013+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:24:18.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.033+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:18.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.039+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:18.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.068+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:24:18.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.075+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:18.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.092+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:24:18.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.109+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:18.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.124+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:18.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.128+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:24:18.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.147+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:18.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.160+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:24:18.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.170+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:24:18.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.201+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:24:18.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.208+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:24:18.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.257+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:24:18.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.290+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:18.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.296+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:24:18.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:24:18.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.329+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:24:18.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:24:18.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.338+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:18.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.359+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:18.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:18.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.388+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:24:18.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.415+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:24:18.434 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.433+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:24:18.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.439+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:24:18.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:24:18.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.457+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:24:18.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.515+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:24:18.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:24:18.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:24:18.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.548+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:24:18.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 282 16 4049744 4049728 897.443 916.312 0.000468664 0.00109977 2024-04-20T02:24:18.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.562+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:24:18.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.579+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:24:18.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.599+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:24:18.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.606+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:24:18.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.618+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:18.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.652+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:24:18.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.655+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:24:18.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.711+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:24:18.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.744+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:18.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.772+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:24:18.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.790+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:18.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.804+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:24:18.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.813+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:24:18.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.816+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:24:18.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:24:18.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.863+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:24:18.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.901+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:24:18.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.909+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:24:18.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.919+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:24:18.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.922+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:18.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.948+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:24:18.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.962+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:24:18.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:18.979+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:24:19.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.006+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:24:19.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.022+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:24:19.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.032+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:24:19.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:19.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.052+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:24:19.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.066+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:24:19.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.073+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:24:19.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.101+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:24:19.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.114+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:24:19.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.119+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:19.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.132+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:24:19.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.136+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:24:19.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.163+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:24:19.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.178+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:24:19.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.183+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:19.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.198+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:19.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.216+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:24:19.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.221+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:24:19.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.256+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:24:19.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.265+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:24:19.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.266+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:24:19.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.273+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:24:19.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.287+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:24:19.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.321+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:24:19.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:24:19.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.349+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:24:19.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.370+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:24:19.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.379+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:24:19.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.404+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:24:19.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.415+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:24:19.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.423+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:19.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.424+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:24:19.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.446+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:24:19.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.447+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:24:19.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.470+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:24:19.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.508+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:24:19.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.530+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:24:19.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.531+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:24:19.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 283 16 4064358 4064342 897.5 913.375 0.0210327 0.0010997 2024-04-20T02:24:19.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.566+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:19.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.572+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:24:19.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.583+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:24:19.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.591+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:19.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.601+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:24:19.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.613+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:19.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.614+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:24:19.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.639+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:19.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.639+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:19.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.675+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:24:19.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.683+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:24:19.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.697+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:19.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.732+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:19.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.752+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:24:19.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.766+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:24:19.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.768+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:24:19.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:24:19.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.817+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:24:19.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.831+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:19.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.839+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:24:19.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:24:19.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.871+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:19.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:24:19.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.900+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:19.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.917+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:19.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.948+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:19.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.965+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:24:19.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:19.993+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:24:20.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.008+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:24:20.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:24:20.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.036+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:24:20.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:24:20.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.063+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:20.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.080+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:24:20.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:24:20.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.121+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:24:20.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.149+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:24:20.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.152+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:20.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.163+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:20.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.178+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:20.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.197+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:24:20.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.222+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:20.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.251+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:20.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.283+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:24:20.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.297+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:24:20.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.302+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:20.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.353+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:24:20.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.372+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:24:20.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.383+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:24:20.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.407+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:20.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.425+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:24:20.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:24:20.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.448+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:20.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.507+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:24:20.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.519+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:24:20.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.542+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:24:20.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 284 16 4079262 4079246 897.619 931.5 0.000612638 0.00109956 2024-04-20T02:24:20.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.573+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:24:20.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.575+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:24:20.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.598+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:20.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.612+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:20.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.621+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:24:20.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.628+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:24:20.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.665+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:24:20.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.709+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:24:20.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.721+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:24:20.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.736+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8c99b6b:::benchmark_data_smithi171_44355_object905:head, will try copies on 2,4 2024-04-20T02:24:20.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.761+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:20.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:20.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.786+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:24:20.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.786+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:24:20.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.796+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:20.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.836+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:20.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:20.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.859+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:24:20.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.890+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:24:20.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.892+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:20.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.901+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:20.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.908+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:24:20.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.933+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:24:20.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.937+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:24:20.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.958+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:20.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.968+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:24:20.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.974+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:20.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.978+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:24:20.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:20.983+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:24:21.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.016+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:24:21.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.027+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:21.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:24:21.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.067+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:24:21.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.073+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:24:21.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.087+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:21.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.114+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:24:21.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.121+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:24:21.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.133+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:21.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.151+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:21.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.166+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:24:21.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.190+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:24:21.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.207+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:24:21.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.224+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:24:21.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:21.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:24:21.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.271+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:24:21.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.312+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:21.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.323+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:24:21.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.349+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:24:21.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.353+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:24:21.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.378+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:21.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.406+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:24:21.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:21.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.409+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:21.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.434+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:21.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.441+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:24:21.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.450+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:24:21.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.484+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:24:21.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.488+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:21.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.489+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:24:21.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.513+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:21.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.514+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:24:21.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.543+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:24:21.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 285 16 4093828 4093812 897.663 910.375 0.00172996 0.0010995 2024-04-20T02:24:21.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.570+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:24:21.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.575+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:24:21.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.603+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:21.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:21.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.691+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:21.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.697+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:24:21.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:24:21.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.726+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:24:21.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.735+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:21.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.743+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:21.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.750+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:24:21.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.752+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:24:21.777 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.778+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:24:21.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.819+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:24:21.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.828+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:24:21.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.854+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:24:21.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.904+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:24:21.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.917+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:24:21.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.926+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:24:21.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.942+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:21.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.945+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:24:21.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.945+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:24:21.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.977+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:24:21.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:21.994+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:24:22.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:24:22.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.053+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:22.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.130+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:24:22.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:22.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.168+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:24:22.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.182+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:24:22.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.184+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:24:22.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.275+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:24:22.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.283+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:24:22.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.318+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:24:22.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.328+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:22.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.350+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:24:22.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.367+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:24:22.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.387+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:24:22.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.416+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:22.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:24:22.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.447+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:24:22.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.468+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:24:22.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.473+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:24:22.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:24:22.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.540+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:24:22.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.541+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:24:22.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 286 15 4108759 4108744 897.788 933.25 0.00077948 0.00109934 2024-04-20T02:24:22.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.558+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:22.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.572+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:22.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.585+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:22.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.593+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:24:22.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.594+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:24:22.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.609+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:24:22.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.613+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:22.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.626+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:22.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.627+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:24:22.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.687+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:24:22.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.699+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:24:22.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:24:22.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.759+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:24:22.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.776+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:24:22.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.844+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:22.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.845+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:24:22.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.906+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:24:22.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.974+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:24:22.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.990+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:22.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.993+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:24:22.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:22.995+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:24:23.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.014+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:24:23.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.030+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:24:23.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.046+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:24:23.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.067+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:24:23.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.096+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:24:23.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:23.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.119+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:24:23.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.171+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:23.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.171+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:24:23.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.202+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:24:23.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.218+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:23.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.240+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:24:23.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.240+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:23.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.253+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:24:23.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:24:23.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.269+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:24:23.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.303+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:24:23.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:24:23.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.335+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:23.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.337+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:24:23.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.337+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:24:23.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.354+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:24:23.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.357+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:24:23.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:24:23.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.393+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:24:23.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.406+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:24:23.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.433+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:24:23.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.443+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:24:23.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.446+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:24:23.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.482+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:24:23.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.496+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:24:23.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.512+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:24:23.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.535+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:24:23.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 287 15 4122587 4122572 897.67 864.25 0.00107034 0.00109949 2024-04-20T02:24:23.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.557+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:24:23.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.585+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:24:23.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.609+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:24:23.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.657+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:24:23.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.688+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:24:23.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.705+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:24:23.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.745+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:24:23.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.750+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:24:23.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.777+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:23.797 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.798+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:24:23.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.822+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:24:23.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.855+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:24:23.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.862+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:23.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.870+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:24:23.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.898+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:23.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.899+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:24:23.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.912+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:23.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.916+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:23.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.933+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:24:23.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:23.964+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:24:24.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.009+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:24.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.029+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:24.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.029+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:24:24.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.033+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:24:24.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.077+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:24.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.090+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:24:24.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.098+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:24:24.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.108+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:24:24.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.129+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:24:24.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.131+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:24:24.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.171+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:24.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.177+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:24:24.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.186+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:24:24.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.190+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:24:24.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:24:24.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.237+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:24:24.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.272+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:24:24.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.277+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:24:24.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.295+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:24:24.320 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.321+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:24:24.338 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.339+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:24:24.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.345+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:24:24.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.362+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:24:24.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.396+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:24:24.463 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.461+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:24:24.487 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.488+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c724a016:::benchmark_data_smithi171_44355_object2761:head, will try copies on 2,4 2024-04-20T02:24:24.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:24:24.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.533+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:24:24.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:24:24.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.546+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:24:24.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 288 16 4137514 4137498 897.792 932.875 0.000775476 0.00109933 2024-04-20T02:24:24.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:24:24.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.574+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:24.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.616+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:24:24.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.647+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:24:24.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.677+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:24:24.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.685+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:24:24.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.713+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:24:24.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:24.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.746+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:24:24.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.750+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:24:24.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.778+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:24:24.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.828+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:24.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.864+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44379ea:::benchmark_data_smithi171_44355_object643:head, will try copies on 2,4 2024-04-20T02:24:24.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.873+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:24:24.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.880+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:24.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.901+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:24.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.902+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:24:24.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.920+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:24:24.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.941+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:24:24.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.946+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:24:24.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.974+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:24:24.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.986+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:24:24.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:24.994+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:24:25.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.004+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:24:25.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.019+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:24:25.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:24:25.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.055+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:25.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.068+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:24:25.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.074+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:24:25.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.102+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:25.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.104+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:25.137 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.137+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:24:25.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.220+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:24:25.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.232+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:24:25.244 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.245+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:25.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.258+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:24:25.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.259+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:24:25.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.272+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:24:25.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.293+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:25.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.316+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:25.339 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.340+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:25.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.364+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:24:25.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:24:25.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.404+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:24:25.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.409+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:25.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.421+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:24:25.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.428+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:24:25.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.444+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:25.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.449+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:24:25.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.476+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:24:25.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:24:25.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.534+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:25.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.538+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:24:25.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 289 16 4151593 4151577 897.73 879.938 0.000578233 0.00109941 2024-04-20T02:24:25.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.561+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:24:25.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.582+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:24:25.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.595+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:24:25.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.601+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:24:25.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.640+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:24:25.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.644+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:24:25.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.672+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:25.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.688+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:24:25.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.688+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:24:25.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.695+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:24:25.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:24:25.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.726+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:24:25.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.741+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:24:25.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.765+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:24:25.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.846+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:25.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.855+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:24:25.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.875+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:24:25.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.895+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:25.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.905+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:25.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.912+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:24:25.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.933+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:24:25.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.934+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:24:25.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.955+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:24:25.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:25.998+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:24:26.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.014+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:24:26.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.028+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:24:26.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.029+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:24:26.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.046+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:24:26.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.091+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:24:26.134 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.135+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:24:26.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:24:26.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.151+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aefc00bb:::benchmark_data_smithi171_44355_object1892:head, will try copies on 0,4 2024-04-20T02:24:26.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.174+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:24:26.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.190+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:24:26.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.210+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:24:26.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.230+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:24:26.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.246+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:24:26.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.263+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:24:26.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.281+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:24:26.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.290+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:26.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:26.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.319+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:24:26.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.345+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:24:26.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.350+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:24:26.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.375+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:24:26.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.395+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:24:26.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.402+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:26.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.434+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:24:26.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.442+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:26.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.452+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:24:26.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.513+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:24:26.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.522+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:24:26.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.542+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:26.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:26.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 290 16 4165314 4165298 897.591 857.562 0.000537643 0.00109958 2024-04-20T02:24:26.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.559+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:26.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.560+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:24:26.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.581+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:24:26.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.590+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:26.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.595+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:26.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.631+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:24:26.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.641+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:24:26.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:26.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.684+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:24:26.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.725+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:24:26.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.743+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:24:26.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.750+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:24:26.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.750+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:26.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:26.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.796+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:24:26.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.811+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:24:26.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.818+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:24:26.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.826+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:24:26.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.867+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:24:26.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:26.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.898+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:24:26.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.909+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:24:26.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.930+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:24:26.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.930+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:24:26.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.938+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:24:26.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:24:26.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.971+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:26.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.977+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:24:26.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:26.992+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:24:27.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.003+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:27.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:24:27.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.039+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:24:27.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.049+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:24:27.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.084+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:24:27.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.085+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:24:27.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.095+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:24:27.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.120+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:24:27.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.162+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:27.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.188+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:24:27.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.203+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:24:27.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.215+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:27.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.264+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:27.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.278+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:24:27.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.288+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:24:27.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.297+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:27.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.301+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:27.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.326+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:24:27.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.328+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:24:27.361 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.361+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:24:27.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.375+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:24:27.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.390+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:24:27.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:27.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.411+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:27.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.414+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:24:27.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.457+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:27.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.465+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:24:27.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.474+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:24:27.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.493+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:24:27.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.536+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:27.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.547+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:27.551 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 291 15 4179378 4179363 897.527 879.062 0.000721375 0.00109966 2024-04-20T02:24:27.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.565+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:27.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.571+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:27.598 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.598+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:27.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.599+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:27.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.616+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:24:27.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.622+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:27.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.628+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:24:27.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.678+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:24:27.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.686+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:24:27.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.706+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:27.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.750+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:24:27.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.761+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:24:27.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.795+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:24:27.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.805+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:24:27.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.806+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:24:27.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.813+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:27.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.822+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:24:27.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.895+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:24:27.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.936+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:24:27.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.946+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:24:27.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.959+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:24:27.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.966+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02c67b2:::benchmark_data_smithi171_44355_object2395:head, will try copies on 0,4 2024-04-20T02:24:27.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:28.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:27.999+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:24:28.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.039+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:24:28.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.041+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:24:28.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.087+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:28.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.104+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:28.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.114+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:24:28.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.120+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:24:28.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:28.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:24:28.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.182+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:28.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.185+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:24:28.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.213+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:24:28.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.217+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:28.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.267+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:24:28.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.282+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:28.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.287+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:28.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.321+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:24:28.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.323+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:24:28.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.359+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:24:28.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.380+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:24:28.404 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.403+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:28.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.414+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:24:28.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.415+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:24:28.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.424+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:24:28.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.456+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:24:28.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.462+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:28.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.471+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:24:28.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.488+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:24:28.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.510+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:24:28.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.535+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:24:28.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.537+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:24:28.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 292 16 4192704 4192688 897.305 832.812 0.000842837 0.00109994 2024-04-20T02:24:28.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:24:28.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.588+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:24:28.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.595+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:28.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.595+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:24:28.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.614+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:28.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.633+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:24:28.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.651+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:24:28.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.665+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:24:28.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.690+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:24:28.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.701+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:28.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:24:28.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.719+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:28.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.737+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:24:28.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.748+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:24:28.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.764+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:24:28.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.776+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:24:28.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.782+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:24:28.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.810+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:24:28.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.843+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:24:28.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.864+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:28.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.891+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:24:28.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.898+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:24:28.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.899+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:24:28.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.958+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:24:28.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:28.989+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:24:29.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.001+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:24:29.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:24:29.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.028+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:24:29.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.036+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:24:29.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.054+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:24:29.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.072+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:29.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.079+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:24:29.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.114+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:24:29.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.121+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:24:29.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.139+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:24:29.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.164+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:24:29.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.165+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:29.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.213+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:24:29.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.271+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:24:29.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.301+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:24:29.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.315+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:29.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.316+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:24:29.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.324+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:24:29.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.344+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:24:29.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.365+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:29.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.385+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:29.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.392+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:24:29.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.420+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:24:29.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.440+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:24:29.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:24:29.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:24:29.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.483+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:29.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.494+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:24:29.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.496+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:29.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.538+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:24:29.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.548+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:24:29.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 293 15 4207208 4207193 897.336 906.562 0.00155167 0.00109991 2024-04-20T02:24:29.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.565+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:24:29.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:24:29.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.622+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:24:29.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.644+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:24:29.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.658+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:24:29.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.659+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:29.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.687+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:29.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.699+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:24:29.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.702+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:24:29.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.724+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:24:29.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.779+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:24:29.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:29.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.788+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:24:29.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.814+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:29.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:24:29.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.889+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:24:29.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.893+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:24:29.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.902+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:24:29.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:24:29.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.943+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:29.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.974+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:29.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:29.994+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:24:30.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:24:30.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.026+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:30.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.043+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:24:30.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.069+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:30.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.096+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:24:30.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.105+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:30.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.136+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:30.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.159+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:30.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.161+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:30.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.186+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:24:30.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.216+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:24:30.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.216+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:30.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.258+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:24:30.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.278+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:30.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.291+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:24:30.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.305+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:24:30.309 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.309+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:30.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.332+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:30.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.342+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:24:30.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.378+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:24:30.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.392+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:24:30.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:24:30.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.427+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:24:30.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.463+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:24:30.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.478+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:24:30.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.495+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:24:30.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.510+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:24:30.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.510+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:24:30.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.536+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:30.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 294 16 4221259 4221243 897.271 878.125 0.000930166 0.00109999 2024-04-20T02:24:30.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.558+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:24:30.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.643+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:24:30.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.653+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:24:30.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.666+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:24:30.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.667+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:24:30.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.696+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:24:30.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.704+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:24:30.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.705+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:24:30.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.731+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:24:30.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.756+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:30.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.765+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:24:30.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.770+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:30.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.781+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:24:30.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.811+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:30.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.834+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:30.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.850+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:24:30.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.868+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:24:30.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.871+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:24:30.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.889+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:30.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.898+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:24:30.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.900+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:24:30.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.932+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:30.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.939+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:24:30.951 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.949+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:24:30.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.958+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:24:30.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:30.991+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:24:31.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.023+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:24:31.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.026+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:24:31.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.029+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:24:31.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.368+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:24:31.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:31.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.377+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:24:31.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:31.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.424+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:31.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.447+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:31.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.454+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:24:31.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:24:31.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.520+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:31.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 295 15 4233020 4233005 896.721 735.125 0.00072969 0.00110068 2024-04-20T02:24:31.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:24:31.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.602+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9183ebf:::benchmark_data_smithi171_44355_object2785:head, will try copies on 0,4 2024-04-20T02:24:31.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.617+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:24:31.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.620+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:31.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.642+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:24:31.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.652+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:24:31.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.664+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:24:31.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.668+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:24:31.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.698+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:24:31.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.709+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:24:31.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.719+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:24:31.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.721+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:31.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.753+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:24:31.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.754+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:31.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c050bfea:::benchmark_data_smithi171_44355_object3919:head, will try copies on 2,4 2024-04-20T02:24:31.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:24:31.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.823+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:24:31.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.849+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:24:31.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.853+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:31.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.869+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:24:31.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.870+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:31.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.891+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a27df7f9:::benchmark_data_smithi171_44355_object2041:head, will try copies on 0,4 2024-04-20T02:24:31.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.893+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:24:31.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.906+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:24:31.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.941+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:24:31.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.953+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:24:31.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.954+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:24:31.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.975+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:31.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.975+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:24:31.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:31.978+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:24:32.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.024+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:24:32.042 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.042+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:32.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.077+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:24:32.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.078+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:24:32.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.099+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:24:32.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.167+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:24:32.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.194+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:24:32.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.222+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:24:32.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.233+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:32.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:24:32.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.275+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:24:32.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.285+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:24:32.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.317+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:24:32.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:32.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.386+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:24:32.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.439+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:24:32.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.439+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:24:32.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:32.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.473+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:24:32.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.490+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:32.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.500+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:24:32.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.525+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:24:32.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.544+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:24:32.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.545+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:32.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 296 16 4247544 4247528 896.757 907.688 0.000922235 0.00110062 2024-04-20T02:24:32.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.564+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:32.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:24:32.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.608+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:24:32.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.617+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:24:32.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.631+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:24:32.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.633+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:32.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.656+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:24:32.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.690+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:24:32.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.699+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:32.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.706+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:32.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.736+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:24:32.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:32.770 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.770+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:32.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.821+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:32.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.836+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:32.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.856+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:24:32.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.860+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:24:32.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.963+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:24:33.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:32.999+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:24:33.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.006+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:24:33.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.032+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:33.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.061+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:24:33.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.066+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:33.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.107+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:24:33.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.109+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:24:33.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.152+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:24:33.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.156+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:24:33.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.185+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:33.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.188+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:24:33.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.193+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:24:33.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.209+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:24:33.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.210+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:24:33.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.260+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:24:33.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.287+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:33.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.302+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:24:33.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.318+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:33.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.328+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:24:33.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.328+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:24:33.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:33.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.380+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:33.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.394+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:24:33.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.405+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:24:33.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.425+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:33.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.443+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:24:33.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.453+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:24:33.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:24:33.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.493+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:24:33.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.493+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:24:33.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.532+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:24:33.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.544+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:24:33.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 297 16 4261281 4261265 896.629 858.562 0.00138357 0.00110079 2024-04-20T02:24:33.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.564+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:24:33.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:33.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.610+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:33.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.610+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:24:33.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.618+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:33.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.630+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:33.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.633+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:24:33.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.643+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:24:33.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.713+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:24:33.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.725+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:33.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c578de41:::benchmark_data_smithi171_44355_object2389:head, will try copies on 2,4 2024-04-20T02:24:33.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.804+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:24:33.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.848+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:33.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.884+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:33.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.906+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:24:33.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:24:33.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.947+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:24:33.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.960+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:24:33.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.961+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:24:33.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.985+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:24:33.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:33.997+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:24:34.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.008+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:24:34.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.010+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:24:34.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.045+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:24:34.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.074+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:24:34.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.090+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:34.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.099+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:24:34.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.124+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:34.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.145+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:24:34.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.166+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:24:34.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.184+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:24:34.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.227+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:24:34.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.242+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:24:34.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.242+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:24:34.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.267+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:24:34.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.268+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:24:34.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.287+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:24:34.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.303+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:24:34.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.317+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:24:34.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.322+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:34.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.327+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:24:34.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.369+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:34.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.378+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:24:34.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.378+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:24:34.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.396+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:24:34.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.418+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:24:34.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.452+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:24:34.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.452+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:24:34.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.516+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:34.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.518+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:24:34.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.521+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:24:34.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.551+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:24:34.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 298 15 4275735 4275720 896.651 903.438 0.000667701 0.00110076 2024-04-20T02:24:34.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.565+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:24:34.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.575+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:24:34.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.599+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:24:34.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:24:34.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.627+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:24:34.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.627+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:24:34.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.630+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:24:34.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.673+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:24:34.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.710+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:34.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.715+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:24:34.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.724+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:24:34.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.743+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:24:34.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.753+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:34.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.775+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:34.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.799+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:34.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.900+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:24:34.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.904+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:34.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.911+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:24:34.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.922+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:24:34.952 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.951+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:24:34.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.959+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:34.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.975+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:24:34.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.981+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:24:34.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:34.993+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:24:35.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.016+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:35.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.017+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:35.026 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.025+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:24:35.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.033+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:35.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.056+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:24:35.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.057+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:24:35.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.080+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:24:35.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.081+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:24:35.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.096+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:24:35.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.101+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:24:35.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c62f1977:::benchmark_data_smithi171_44355_object2279:head, will try copies on 2,4 2024-04-20T02:24:35.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.132+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:35.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.148+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:24:35.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.174+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:24:35.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.177+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:24:35.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.205+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:24:35.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.236+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:35.237 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.236+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:24:35.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.275+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:24:35.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.299+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:24:35.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.306+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:24:35.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.312+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:35.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:35.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.344+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:24:35.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:35.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.353+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:35.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.366+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:24:35.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.374+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:24:35.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.413+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:24:35.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.430+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:24:35.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.468+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:24:35.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.483+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:24:35.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.518+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:24:35.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.541+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:24:35.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.548+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:24:35.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 299 16 4289290 4289274 896.485 847.125 0.000834503 0.00110096 2024-04-20T02:24:35.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.571+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:24:35.587 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.587+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:35.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.613+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:35.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.622+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:24:35.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.634+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:35.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.641+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:24:35.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.655+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:35.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.662+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:24:35.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.715+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:35.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.724+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:35.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.738+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:24:35.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.752+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:24:35.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.768+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:24:35.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.787+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:24:35.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.810+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:35.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.834+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:24:35.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.854+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:24:35.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:24:35.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.861+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:24:35.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.881+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:35.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.888+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:35.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.892+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:24:35.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.932+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:24:35.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.935+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:24:35.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.945+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:24:35.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.963+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:24:35.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.981+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:24:35.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:35.997+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:36.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.024+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:36.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.045+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:24:36.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.064+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:24:36.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.075+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:36.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:24:36.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.087+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:36.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.092+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:24:36.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:24:36.120 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.120+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:24:36.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.129+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:24:36.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.131+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:24:36.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.159+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:24:36.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.160+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:24:36.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.166+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:24:36.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.190+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:24:36.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.194+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:36.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.205+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:24:36.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:24:36.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.238+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:24:36.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.250+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:36.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:24:36.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.272+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:24:36.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.326+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:24:36.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.329+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:24:36.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:24:36.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:24:36.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.377+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:24:36.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.380+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:24:36.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.398+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:36.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.416+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:24:36.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.418+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:24:36.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.439+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:24:36.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.441+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:36.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:24:36.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.513+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:36.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:24:36.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.535+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:24:36.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.536+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:24:36.552 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:24:36.554008+0000 min lat: 0.000210708 max lat: 0.343331 avg lat: 0.00110094 2024-04-20T02:24:36.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:24:36.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 300 16 4303729 4303713 896.505 902.438 0.000717713 0.00110094 2024-04-20T02:24:36.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.563+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee31f5d8:::benchmark_data_smithi171_44355_object3324:head, will try copies on 0,4 2024-04-20T02:24:36.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.576+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:24:36.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.588+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:24:36.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.626+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:24:36.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.654+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:24:36.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.675+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:24:36.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.705+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:24:36.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.743+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:24:36.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:36.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.747+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:24:36.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.779+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:36.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.790+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:24:36.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.812+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:24:36.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.845+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:24:36.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:36.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.882+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:24:36.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.885+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:24:36.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.903+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:24:36.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:24:36.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.950+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:24:36.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.965+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:24:36.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.973+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:24:36.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:36.996+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:24:37.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.002+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:24:37.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.033+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:37.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.082+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:37.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.104+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:24:37.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.123+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:24:37.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.129+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:24:37.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.144+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:24:37.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.168+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:24:37.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.182+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:24:37.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.193+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:24:37.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.220+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:24:37.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:24:37.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.247+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:24:37.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.271+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:24:37.290 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.290+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:37.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.310+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:24:37.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.317+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:24:37.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.343+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:24:37.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.345+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:24:37.358 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:37.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.362+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:24:37.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.390+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:24:37.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.421+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca1d05d8:::benchmark_data_smithi171_44355_object3141:head, will try copies on 2,4 2024-04-20T02:24:37.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.445+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:37.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.451+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:37.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.533+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:24:37.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 301 16 4318494 4318478 896.592 922.812 0.000943015 0.00110083 2024-04-20T02:24:37.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.558+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:24:37.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.566+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:24:37.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.601+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:24:37.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.614+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee392e95:::benchmark_data_smithi171_44355_object430:head, will try copies on 0,4 2024-04-20T02:24:37.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.710+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a226b210:::benchmark_data_smithi171_44355_object227:head, will try copies on 0,4 2024-04-20T02:24:37.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.717+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:24:37.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.774+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:24:37.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.790+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:24:37.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.823+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:24:37.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.826+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:24:37.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.836+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:24:37.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.847+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:24:37.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.864+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:24:37.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.873+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:24:37.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.885+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:24:37.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.935+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:24:37.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.938+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:24:37.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.973+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:24:37.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.976+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:37.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.980+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:38.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:37.999+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:24:38.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.007+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:24:38.041 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.041+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:24:38.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.054+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:38.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:24:38.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.092+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:38.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.093+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:38.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.107+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:24:38.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.121+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:24:38.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.135+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:24:38.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.142+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:24:38.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.159+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:24:38.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.166+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:24:38.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.178+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:38.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.187+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:38.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.198+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:24:38.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.208+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:24:38.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.218+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:24:38.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.236+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:24:38.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.246+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:24:38.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.261+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:24:38.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.263+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:24:38.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.290+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:24:38.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.296+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:24:38.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.323+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:24:38.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.327+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:24:38.368 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.367+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:24:38.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.369+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:24:38.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.372+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:38.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.386+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:24:38.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.398+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:24:38.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.418+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:24:38.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.423+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:38.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.440+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:24:38.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.444+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:38.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.455+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:38.469 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.468+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:38.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.471+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:38.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.504+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:38.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.510+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:24:38.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.538+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:24:38.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.544+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:24:38.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.546+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:24:38.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 302 16 4332972 4332956 896.619 904.875 0.00115016 0.0011008 2024-04-20T02:24:38.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.564+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:24:38.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.589+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:24:38.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.627+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:24:38.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.650+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:24:38.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.657+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:24:38.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.660+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:24:38.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.680+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:24:38.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.697+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:24:38.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.707+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:24:38.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:38.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.746+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:38.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:24:38.781 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.781+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:38.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.794+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:24:38.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.804+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:24:38.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.805+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:24:38.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.824+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:24:38.845 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.845+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:24:38.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.864+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:24:38.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.874+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:24:38.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.889+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:38.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.889+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:24:38.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.894+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:38.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:24:38.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.952+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:24:38.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.958+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:24:38.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.963+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:38.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.976+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:24:38.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:38.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:24:39.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.000+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:24:39.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.018+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:24:39.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.039+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:24:39.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.044+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:24:39.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.058+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:39.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.092+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:24:39.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.124+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:39.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:24:39.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.175+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:39.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.191+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:24:39.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.203+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:39.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.209+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:24:39.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.225+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:24:39.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.259+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:39.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.277+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:24:39.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.285+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:24:39.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.287+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:39.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.300+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:24:39.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.322+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:39.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.345+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:24:39.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.369+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:24:39.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.375+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:24:39.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.388+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:39.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbdf95e2:::benchmark_data_smithi171_44355_object1746:head, will try copies on 2,4 2024-04-20T02:24:39.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.409+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:24:39.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.416+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:39.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.445+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:39.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.446+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:24:39.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:24:39.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.467+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee85039a:::benchmark_data_smithi171_44355_object3763:head, will try copies on 0,4 2024-04-20T02:24:39.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.476+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:39.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.488+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:24:39.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.509+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:24:39.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.521+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:24:39.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.527+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:24:39.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.541+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:39.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.546+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:24:39.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 303 16 4347414 4347398 896.639 902.625 0.00118962 0.00110077 2024-04-20T02:24:39.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.560+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:39.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.577+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:24:39.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:39.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.603+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:24:39.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.612+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:24:39.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.615+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:24:39.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.645+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:24:39.656 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.656+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:24:39.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.690+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:24:39.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.696+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:39.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.708+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:24:39.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:24:39.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.725+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:24:39.745 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.745+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:24:39.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.761+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:24:39.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.774+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:24:39.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:24:39.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.807+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:24:39.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.817+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:24:39.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.823+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:24:39.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.863+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:24:39.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.882+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:24:39.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.898+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:39.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.907+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:24:39.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.909+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:24:39.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.960+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:24:39.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.979+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:24:39.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.979+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:24:39.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.983+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:24:39.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:39.999+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:40.056 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.056+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:40.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.080+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:24:40.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.080+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:24:40.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.100+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:40.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.107+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:24:40.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.109+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:24:40.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.126+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:40.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.150+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:24:40.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.154+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:24:40.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.176+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:24:40.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.176+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:24:40.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.255+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:40.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.265+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:24:40.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.268+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:24:40.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.284+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:40.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.302+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:24:40.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.313+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:24:40.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.346+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:24:40.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.359+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:24:40.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.362+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:24:40.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.369+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:24:40.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.385+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:24:40.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:40.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.417+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:40.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:24:40.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.435+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:24:40.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.461+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:40.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:40.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.496+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:24:40.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.506+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:24:40.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.509+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:24:40.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:40.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 304 16 4361863 4361847 896.66 903.062 0.000920026 0.00110076 2024-04-20T02:24:40.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.591+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:40.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.593+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:24:40.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.612+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:40.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.623+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:24:40.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.634+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:24:40.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.636+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:24:40.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.681+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:24:40.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.720+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:24:40.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.731+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:24:40.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.732+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:24:40.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.766+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:24:40.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.777+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:24:40.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.817+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:40.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.842+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:24:40.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.861+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:24:40.876 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.876+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:24:40.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.891+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:24:40.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.894+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:24:40.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.900+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:24:40.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.919+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:24:40.944 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.944+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:40.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:40.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:24:41.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.011+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:41.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.034+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:24:41.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.043+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:24:41.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.072+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:24:41.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.073+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:24:41.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.100+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:24:41.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.154+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:41.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.172+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:41.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.183+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:41.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.203+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:24:41.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.218+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:24:41.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.223+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:41.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.238+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:24:41.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.243+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:24:41.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.271+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:41.278 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.278+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:41.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.294+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:41.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.296+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:24:41.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.301+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:41.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.325+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:24:41.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.329+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:24:41.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.334+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:24:41.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.378+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13de581:::benchmark_data_smithi171_44355_object1639:head, will try copies on 0,4 2024-04-20T02:24:41.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.402+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:24:41.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.426+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:24:41.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:24:41.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.456+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:24:41.462 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.461+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:24:41.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.498+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:24:41.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.509+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:24:41.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.517+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:24:41.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.522+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:24:41.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.543+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:24:41.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.545+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:24:41.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 305 16 4376523 4376507 896.724 916.25 0.00057513 0.00110067 2024-04-20T02:24:41.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.608+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:24:41.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.614+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:24:41.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.625+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:24:41.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.640+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:41.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.654+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:24:41.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.655+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:24:41.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.702+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:24:41.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.738+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:24:41.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.750+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:24:41.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.758+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:41.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.793+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:41.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.818+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:24:41.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.825+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:24:41.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:41.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.866+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:41.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.882+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:24:41.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.891+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:24:41.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.918+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:24:41.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.960+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:24:41.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:41.964+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:42.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.008+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:24:42.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.029+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:24:42.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.035+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:24:42.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.052+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:24:42.089 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.089+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:24:42.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.089+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:24:42.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.105+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:24:42.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.109+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:24:42.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.130+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:24:42.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.151+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:42.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:24:42.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.173+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:24:42.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.178+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:24:42.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.181+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:24:42.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.208+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:42.220 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.220+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:42.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.224+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:42.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.260+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:24:42.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.263+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:42.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.297+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:24:42.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.307+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:24:42.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.312+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:24:42.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.330+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:24:42.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.341+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:24:42.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.374+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:24:42.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.377+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:24:42.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.409+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:24:42.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.426+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:24:42.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.440+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:42.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.455+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:24:42.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.500+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384fd18:::benchmark_data_smithi171_44355_object2256:head, will try copies on 0,4 2024-04-20T02:24:42.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.503+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:24:42.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.521+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:24:42.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.530+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:24:42.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.544+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:24:42.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 306 16 4390832 4390816 896.715 894.312 0.000733019 0.00110069 2024-04-20T02:24:42.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.565+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:24:42.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:24:42.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.617+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:24:42.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.619+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:24:42.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.619+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:24:42.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.654+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:24:42.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.667+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:24:42.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.675+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:24:42.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.692+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:24:42.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.692+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:42.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.699+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:24:42.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.718+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:24:42.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.721+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:24:42.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.754+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:24:42.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.768+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:24:42.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.789+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:24:42.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.793+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:24:42.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.811+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:24:42.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.890+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:24:42.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.899+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:24:42.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.903+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:42.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.930+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:42.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.934+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:42.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.984+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:24:42.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:42.998+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:24:43.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.025+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:24:43.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.047+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:43.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.047+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:24:43.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.062+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:43.149 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.149+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:24:43.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.156+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca0ca7fb:::benchmark_data_smithi171_44355_object2552:head, will try copies on 2,4 2024-04-20T02:24:43.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.185+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:43.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.193+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:24:43.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.202+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:24:43.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.209+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:24:43.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:24:43.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.242+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:24:43.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:24:43.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.257+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:24:43.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.270+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:43.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.273+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:24:43.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.296+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:24:43.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.327+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:24:43.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.356+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:24:43.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.357+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:43.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.376+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:24:43.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.394+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:24:43.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.414+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:24:43.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:24:43.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.433+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:24:43.451 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.451+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:24:43.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.471+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:24:43.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.483+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:24:43.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.488+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:43.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.495+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:24:43.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.516+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:24:43.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.526+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc1e08dc:::benchmark_data_smithi171_44355_object220:head, will try copies on 2,4 2024-04-20T02:24:43.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.535+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:24:43.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 307 16 4404449 4404433 896.566 851.062 0.000659871 0.00110087 2024-04-20T02:24:43.582 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.581+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:43.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.615+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:24:43.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.616+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:43.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.649+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:24:43.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.685+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:24:43.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.710+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:24:43.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.725+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:43.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.729+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:24:43.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.734+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:24:43.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.772+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:24:43.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.795+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:24:43.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.806+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:43.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.827+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:24:43.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.844+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:43.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.859+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:24:43.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.867+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:24:43.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.887+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:24:43.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.897+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:24:43.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.919+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:24:43.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.941+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:24:43.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.955+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:24:43.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:24:43.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:43.996+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:24:44.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.004+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:24:44.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.015+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:24:44.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.033+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:24:44.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.050+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:24:44.074 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.073+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:24:44.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.081+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:24:44.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.093+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:24:44.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.095+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:24:44.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.122+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:44.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.126+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:24:44.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.152+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:24:44.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.154+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:44.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.171+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:24:44.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.192+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:24:44.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.197+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2832562:::benchmark_data_smithi171_44355_object2232:head, will try copies on 0,4 2024-04-20T02:24:44.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.242+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:24:44.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.243+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:24:44.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.273+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:24:44.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.279+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:24:44.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.279+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:24:44.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.310+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:24:44.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.311+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:24:44.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.342+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:44.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:44.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.364+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:24:44.370 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.370+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:44.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.382+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:24:44.410 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.410+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:24:44.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.454+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:24:44.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.459+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:44.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:24:44.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.501+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:24:44.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.520+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:24:44.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.523+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:24:44.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.536+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:24:44.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 308 16 4418882 4418866 896.584 902.062 0.017361 0.00110085 2024-04-20T02:24:44.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.560+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:24:44.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.570+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:44.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:24:44.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.597+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:44.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.624+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:24:44.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.624+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:44.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.639+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:24:44.646 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.646+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:24:44.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.658+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:44.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.670+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:24:44.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.674+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:24:44.699 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.699+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:24:44.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.704+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:24:44.733 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.733+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:24:44.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:24:44.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.767+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:44.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.787+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:24:44.808 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.808+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:24:44.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.855+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:24:44.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:44.975+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:45.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.023+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:24:45.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.081+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:24:45.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:24:45.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.171+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:24:45.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.182+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:24:45.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.193+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:24:45.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.203+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:24:45.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.211+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:24:45.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.234+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:45.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.235+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:45.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.275+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:24:45.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.298+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:24:45.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.300+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:24:45.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.332+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:24:45.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.341+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:24:45.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.350+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:24:45.365 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.365+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:24:45.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c96bed2d:::benchmark_data_smithi171_44355_object2514:head, will try copies on 2,4 2024-04-20T02:24:45.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.393+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:24:45.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.410+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:45.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.416+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:24:45.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.428+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c561021b:::benchmark_data_smithi171_44355_object329:head, will try copies on 2,4 2024-04-20T02:24:45.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.437+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:24:45.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:45.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.461+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:24:45.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.517+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:24:45.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.525+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:24:45.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.545+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:45.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 309 16 4431500 4431484 896.234 788.625 0.00237462 0.00110128 2024-04-20T02:24:45.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:24:45.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:24:45.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.588+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:24:45.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.596+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:45.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.610+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:24:45.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.615+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:24:45.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.632+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:24:45.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.637+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:45.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.668+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:24:45.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.723+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:24:45.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.726+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:24:45.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.749+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:24:45.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.761+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:24:45.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.778+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:45.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.801+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:45.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.806+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:24:45.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.821+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:24:45.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.831+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:24:45.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.842+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:24:45.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.862+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:45.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.887+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:24:45.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.892+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:24:45.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.908+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:24:45.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.925+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:24:45.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.933+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:24:45.955 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.955+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:45.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.958+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:24:45.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:45.983+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:24:46.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.032+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:24:46.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.040+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:24:46.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.052+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:24:46.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.066+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:24:46.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.100+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:24:46.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.106+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:24:46.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.137+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:24:46.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.177+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:24:46.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.196+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:24:46.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.206+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:24:46.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.219+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:24:46.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:24:46.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.252+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:46.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.256+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:24:46.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.270+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:24:46.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.305+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:24:46.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.306+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:46.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.312+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:24:46.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.323+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:24:46.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.359+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:24:46.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:24:46.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.392+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:46.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.414+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:24:46.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.418+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:46.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.435+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:24:46.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.452+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:24:46.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.456+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:24:46.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.468+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:24:46.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.476+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:24:46.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.497+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:24:46.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.513+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:24:46.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.516+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:46.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.521+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:24:46.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.540+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:24:46.553 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 310 15 4445983 4445968 896.263 905.25 0.00278125 0.00110124 2024-04-20T02:24:46.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.554+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:24:46.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.593+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:24:46.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.611+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:46.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.633+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:24:46.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.633+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:24:46.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.648+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:24:46.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.663+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:24:46.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.684+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:46.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.686+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:24:46.705 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.705+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:24:46.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.748+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:24:46.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.766+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:46.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.786+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:24:46.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.792+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:24:46.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.793+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:24:46.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.800+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:24:46.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.815+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:46.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.867+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:24:46.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.880+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:24:46.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.895+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:46.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.898+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:24:46.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.900+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:24:46.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.917+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:24:46.940 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.940+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:46.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.974+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:24:46.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:46.990+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:24:47.003 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.003+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:47.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.011+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:24:47.025 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.025+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:47.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.035+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:24:47.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.045+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:47.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.058+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:24:47.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.096+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:24:47.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.160+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:24:47.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.176+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:47.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.223+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:47.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:24:47.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.234+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:24:47.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.250+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:24:47.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.268+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:24:47.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.276+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:24:47.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.294+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96a35d5:::benchmark_data_smithi171_44355_object2973:head, will try copies on 0,4 2024-04-20T02:24:47.312 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.312+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:24:47.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.313+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:24:47.359 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.359+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:47.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.369+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:24:47.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.375+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:24:47.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.403+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:24:47.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.412+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:24:47.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.460+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62eb97d:::benchmark_data_smithi171_44355_object3139:head, will try copies on 0,4 2024-04-20T02:24:47.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.484+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:47.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.500+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:24:47.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.509+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:47.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.522+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:24:47.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:47.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.550+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:24:47.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 311 16 4460082 4460066 896.214 881.125 0.00133888 0.00110131 2024-04-20T02:24:47.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:24:47.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.578+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:47.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.588+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:24:47.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:24:47.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.614+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:24:47.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.685+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:24:47.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.688+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:24:47.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.710+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:47.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.717+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:47.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.751+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce5ea9fe:::benchmark_data_smithi171_44355_object3368:head, will try copies on 2,4 2024-04-20T02:24:47.774 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.773+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:24:47.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.787+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:24:47.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.795+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:24:47.806 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.806+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:47.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.828+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:47.839 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.838+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:24:47.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.852+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:47.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.861+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:24:47.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.872+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:24:47.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.887+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:24:47.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.910+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:24:47.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:47.916+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:48.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.008+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:24:48.019 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.018+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:24:48.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.027+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:24:48.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.043+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:24:48.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.046+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a1d99c:::benchmark_data_smithi171_44355_object660:head, will try copies on 2,4 2024-04-20T02:24:48.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.057+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:24:48.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.078+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:24:48.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.082+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:24:48.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.091+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:24:48.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.101+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:24:48.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.107+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:48.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.132+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:24:48.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.151+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:48.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.155+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:24:48.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.158+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:48.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.176+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:24:48.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.193+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:24:48.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.201+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:24:48.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.217+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:24:48.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:48.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.269+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:24:48.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:24:48.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.297+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:24:48.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.310+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:24:48.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.323+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:24:48.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.323+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:24:48.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.362+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:24:48.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.364+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:24:48.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.387+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:24:48.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.408+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:48.424 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:24:48.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.448+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:24:48.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.457+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:24:48.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.469+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:24:48.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.470+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:48.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.471+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:24:48.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.507+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:24:48.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.526+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:48.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 312 16 4473162 4473146 895.962 817.5 0.000729756 0.00110163 2024-04-20T02:24:48.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.561+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:48.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.563+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:24:48.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.575+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:24:48.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.589+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:48.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.603+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c812a5f2:::benchmark_data_smithi171_44355_object3815:head, will try copies on 2,4 2024-04-20T02:24:48.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.622+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:24:48.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.637+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:24:48.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.642+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:48.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.651+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:48.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.679+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:24:48.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.707+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:48.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.709+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:24:48.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.741+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:24:48.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:24:48.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:24:48.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.790+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:24:48.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.798+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:24:48.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.819+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:24:48.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.835+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:24:48.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:24:48.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.850+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:24:48.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.852+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:48.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.879+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:24:48.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.885+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:48.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.907+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:48.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:24:48.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.942+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:24:48.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.948+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:24:48.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.954+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:24:48.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.975+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:24:48.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:48.978+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:24:49.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.011+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:49.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.012+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:24:49.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.035+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:49.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.039+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:24:49.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.081+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:24:49.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.086+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:49.103 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.103+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:24:49.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.167+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:24:49.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.180+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:24:49.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.187+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:49.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.192+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:24:49.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.212+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:24:49.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.227+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:24:49.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.264+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:24:49.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.295+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:24:49.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.308+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:24:49.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.331+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:24:49.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.346+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:24:49.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.363+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:24:49.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:24:49.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.395+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:24:49.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.401+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:24:49.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.431+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:24:49.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.456+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:24:49.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.473+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:49.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:24:49.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.507+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:24:49.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.510+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:24:49.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.519+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:24:49.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.553+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:24:49.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 313 16 4486911 4486895 895.844 859.312 0.00152892 0.00110178 2024-04-20T02:24:49.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.571+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:24:49.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.575+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:24:49.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.585+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:24:49.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.591+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:24:49.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.597+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:24:49.615 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.615+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:49.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.630+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:49.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.662+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:24:49.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.680+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:24:49.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.690+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:49.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.700+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:49.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.714+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:24:49.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.725+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eecbd345:::benchmark_data_smithi171_44355_object254:head, will try copies on 0,4 2024-04-20T02:24:49.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.748+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:24:49.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.750+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:24:49.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.760+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:24:49.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:24:49.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.794+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:24:49.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:24:49.835 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:24:49.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.845+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:24:49.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.857+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:24:49.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.861+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:49.881 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.881+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:24:49.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.911+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:49.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.917+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:24:49.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.927+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:24:49.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.976+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:24:49.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.982+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:24:49.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:49.989+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:24:50.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.029+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:50.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.077+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:24:50.098 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.098+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:24:50.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.121+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:24:50.124 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.123+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:24:50.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.155+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:24:50.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.167+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:24:50.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.171+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:24:50.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.192+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:50.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.201+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:24:50.203 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.202+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:24:50.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.220+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:50.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.228+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:24:50.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.252+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:24:50.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.263+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:24:50.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.274+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:24:50.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.280+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:24:50.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.324+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:24:50.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.342+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:24:50.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.378+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:24:50.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:24:50.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.415+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:24:50.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.474+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:24:50.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.475+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:24:50.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.510+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:24:50.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.512+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:24:50.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.536+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:24:50.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 314 15 4500627 4500612 895.721 857.312 0.000746879 0.00110193 2024-04-20T02:24:50.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.562+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:24:50.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.571+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a0c690:::benchmark_data_smithi171_44355_object804:head, will try copies on 0,4 2024-04-20T02:24:50.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.585+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:50.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:24:50.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.604+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:24:50.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.610+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:24:50.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.625+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:24:50.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.639+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:24:50.647 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.647+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:24:50.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.667+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:24:50.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.705+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:24:50.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.710+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:24:50.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.722+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:24:50.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.734+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:24:50.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.762+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:50.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:24:50.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.801+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:24:50.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.805+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:24:50.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.862+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:24:50.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.877+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:24:50.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.920+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:24:50.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.945+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a658f3f7:::benchmark_data_smithi171_44355_object2698:head, will try copies on 0,4 2024-04-20T02:24:50.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.953+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:24:50.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.960+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:24:50.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.967+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:50.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.977+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:24:50.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:50.994+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:24:51.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.027+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:24:51.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.039+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:51.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.065+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:51.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.093+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:24:51.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.096+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7aa982:::benchmark_data_smithi171_44355_object2145:head, will try copies on 0,4 2024-04-20T02:24:51.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.139+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:24:51.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.147+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:24:51.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.156+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:51.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.188+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:24:51.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.191+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:24:51.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.208+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:24:51.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.239+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:24:51.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.243+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:24:51.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.246+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:51.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.269+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:24:51.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.277+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:51.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.285+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:24:51.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.308+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:51.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:24:51.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.341+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:24:51.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.347+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:51.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.376+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:24:51.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.400+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:24:51.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.416+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:51.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.459+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:24:51.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.467+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:24:51.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.492+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:51.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.494+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:24:51.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.513+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:51.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.540+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:24:51.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 315 16 4515177 4515161 895.764 909.312 0.000762356 0.00110188 2024-04-20T02:24:51.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.555+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:24:51.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.582+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:51.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.593+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:51.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.597+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:24:51.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.619+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:24:51.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.638+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:24:51.668 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.668+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:24:51.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.713+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:24:51.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.713+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:51.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.744+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:51.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.750+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:24:51.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.763+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:51.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:24:51.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.785+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:24:51.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.799+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:24:51.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.816+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:24:51.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.827+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:24:51.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:24:51.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.855+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:24:51.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.888+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:24:51.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.892+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:51.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.903+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:51.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.911+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:24:51.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.925+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:24:51.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.945+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:24:51.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.963+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:24:51.966 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.966+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:51.993 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:51.993+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:24:52.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.020+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:24:52.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.037+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:24:52.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.039+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:24:52.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.040+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:24:52.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.062+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:24:52.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.077+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:24:52.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.084+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:24:52.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.096+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:24:52.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.107+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:24:52.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.128+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:24:52.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.129+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:24:52.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.145+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:24:52.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.158+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:24:52.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.164+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:52.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.211+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:24:52.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.237+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:24:52.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.250+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:24:52.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.254+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:24:52.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.283+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:24:52.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.304+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:24:52.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.317+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:52.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.335+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:24:52.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.345+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:24:52.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.366+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:24:52.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.373+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:52.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.391+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:24:52.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.396+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:24:52.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.411+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:24:52.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.426+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a39e6158:::benchmark_data_smithi171_44355_object1333:head, will try copies on 0,4 2024-04-20T02:24:52.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:24:52.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.475+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:52.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.478+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:24:52.493 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.492+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:24:52.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.498+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:24:52.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.515+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:24:52.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.522+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:52.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.544+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:24:52.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 316 15 4529474 4529459 895.757 893.625 0.00124031 0.00110188 2024-04-20T02:24:52.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.571+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:24:52.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.573+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:24:52.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.592+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:24:52.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.604+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:24:52.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.621+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:52.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.635+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:24:52.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.653+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:24:52.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.654+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:24:52.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.660+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:24:52.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.688+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:24:52.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.703+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:24:52.713 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.713+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:24:52.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.722+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:24:52.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.745+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:24:52.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:24:52.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.757+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:24:52.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.767+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:24:52.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.767+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:24:52.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.794+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:24:52.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.829+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:24:52.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.835+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:24:52.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.869+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:24:52.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.877+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:24:52.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.887+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:24:52.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.889+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:24:52.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.897+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:24:52.938 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.937+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:24:52.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.941+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:24:52.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.968+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:24:52.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.968+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:24:52.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.983+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:24:52.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:52.989+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:24:53.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.043+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:24:53.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.044+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:24:53.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.054+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba38dd5:::benchmark_data_smithi171_44355_object2992:head, will try copies on 0,4 2024-04-20T02:24:53.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.066+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:24:53.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.069+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:24:53.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.088+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:24:53.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.111+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:24:53.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.129+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:24:53.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.140+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cf49aa:::benchmark_data_smithi171_44355_object4108:head, will try copies on 0,4 2024-04-20T02:24:53.154 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.154+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:53.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.176+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:24:53.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.189+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:24:53.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.190+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:24:53.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.228+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:24:53.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.229+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:24:53.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:24:53.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.274+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:24:53.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.281+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:24:53.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.313+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:24:53.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.328+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:53.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.330+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:24:53.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.343+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:53.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.395+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:24:53.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.396+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:24:53.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:24:53.414 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.414+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:24:53.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.447+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:24:53.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.448+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:24:53.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.453+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:53.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.475+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:24:53.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.476+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:24:53.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.489+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:24:53.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.505+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:24:53.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.525+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:24:53.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.533+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:24:53.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.541+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:24:53.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 317 16 4543642 4543626 895.724 885.438 0.00113707 0.00110193 2024-04-20T02:24:53.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.564+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:24:53.589 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.589+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:24:53.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.608+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:24:53.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.617+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:53.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.636+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:24:53.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.657+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:24:53.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.662+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:24:53.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.669+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:24:53.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.678+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:24:53.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.710+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:24:53.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.753+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:24:53.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.789+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:24:53.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.810+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:24:53.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.814+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:24:53.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.832+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:24:53.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.847+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:24:53.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.858+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:24:53.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:24:53.880 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.880+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:24:53.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.891+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:24:53.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.893+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:24:53.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae970415:::benchmark_data_smithi171_44355_object2949:head, will try copies on 0,4 2024-04-20T02:24:53.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.924+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:24:53.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.953+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:24:53.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:24:53.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.985+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:24:53.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.988+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:53.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:53.990+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:24:54.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.006+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:24:54.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.010+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:24:54.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.023+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:24:54.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.033+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:54.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.045+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:24:54.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.068+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:24:54.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.071+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:24:54.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:24:54.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:54.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.116+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:24:54.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.142+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:24:54.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.142+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:24:54.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.155+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:24:54.172 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.170+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:24:54.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.173+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:54.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.191+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:54.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.200+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:54.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.200+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:24:54.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.208+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:24:54.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.228+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:24:54.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.255+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:24:54.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.279+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:24:54.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.319+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:24:54.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.319+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:24:54.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.334+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:24:54.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.381+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:24:54.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:54.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.422+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:24:54.425 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.424+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:24:54.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.428+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:24:54.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.460+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:54.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.465+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:24:54.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.490+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:24:54.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:24:54.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:24:54.554 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 318 16 4557769 4557753 895.683 882.938 0.000493321 0.00110198 2024-04-20T02:24:54.557 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.556+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:24:54.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.572+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:24:54.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.613+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:24:54.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.626+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:24:54.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.628+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:24:54.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.661+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:54.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.669+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:24:54.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.696+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:24:54.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.700+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:24:54.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.701+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:24:54.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.753+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:24:54.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.790+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:24:54.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.795+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:24:54.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.837+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:24:54.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.854+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:24:54.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.859+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:24:54.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.892+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:24:54.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.923+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:24:54.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:54.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:24:55.015 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.015+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:24:55.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.043+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:24:55.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.063+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:24:55.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.093+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:24:55.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.094+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:24:55.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.106+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:24:55.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.118+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:24:55.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.147+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:24:55.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.148+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:24:55.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.174+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:24:55.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.196+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:24:55.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.209+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:24:55.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.225+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:24:55.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.261+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:24:55.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.286+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:24:55.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.294+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:24:55.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.310+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:24:55.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.322+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:24:55.329 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.329+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:24:55.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.368+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:24:55.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.401+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:24:55.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.449+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:24:55.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.470+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:55.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.493+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:24:55.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.519+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:24:55.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.536+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:24:55.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 319 16 4571472 4571456 895.56 856.438 0.000909152 0.00110213 2024-04-20T02:24:55.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.561+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:24:55.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.562+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:24:55.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.572+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:24:55.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:24:55.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.618+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4da11fc:::benchmark_data_smithi171_44355_object1154:head, will try copies on 2,4 2024-04-20T02:24:55.632 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.632+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:55.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.654+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:55.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.672+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:55.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.695+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:55.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.726+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:24:55.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.802+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:24:55.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.845+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:55.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.856+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:24:55.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.896+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:55.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.910+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:24:55.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.911+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:24:55.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.929+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3cd1b67:::benchmark_data_smithi171_44355_object407:head, will try copies on 0,4 2024-04-20T02:24:55.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:55.958+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:24:56.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.003+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:24:56.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.005+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:24:56.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.007+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:24:56.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.017+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:24:56.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.043+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:24:56.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.071+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:56.112 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.112+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:24:56.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.131+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:24:56.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.136+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:24:56.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.157+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:24:56.178 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.178+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9729ebd:::benchmark_data_smithi171_44355_object1851:head, will try copies on 2,4 2024-04-20T02:24:56.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.182+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:24:56.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.191+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:24:56.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.197+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:24:56.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.214+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:24:56.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.225+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:24:56.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.253+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:24:56.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.326+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:24:56.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.332+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:24:56.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.353+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:24:56.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.375+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:24:56.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.383+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:24:56.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.407+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:24:56.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.412+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:24:56.430 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.430+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:24:56.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.436+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:24:56.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.469+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:24:56.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.470+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:24:56.526 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.526+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:24:56.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.540+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c421e808:::benchmark_data_smithi171_44355_object4012:head, will try copies on 2,4 2024-04-20T02:24:56.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:24:56.556086+0000 min lat: 0.000210708 max lat: 0.343331 avg lat: 0.00110206 2024-04-20T02:24:56.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:24:56.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 320 16 4586097 4586081 895.617 914.062 0.00183543 0.00110206 2024-04-20T02:24:56.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.557+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:24:56.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.575+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:24:56.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.604+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:24:56.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.610+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:24:56.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.635+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:24:56.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.635+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:24:56.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.636+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:24:56.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.685+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:24:56.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.704+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:24:56.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:24:56.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.743+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:24:56.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.743+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:56.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.764+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:24:56.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.777+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:24:56.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.790+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:24:56.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.799+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:24:56.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.807+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:24:56.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.824+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:24:56.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.842+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:24:56.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.862+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:56.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:24:56.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.878+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:24:56.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.892+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:24:56.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.932+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:24:56.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.941+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:24:56.971 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.971+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:24:56.984 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.984+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:24:56.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:56.988+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:24:57.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.001+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:24:57.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.028+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:24:57.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.047+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:24:57.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.052+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:24:57.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:24:57.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.086+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:24:57.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.088+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:24:57.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.102+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:24:57.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.132+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:24:57.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.135+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1ad46ca:::benchmark_data_smithi171_44355_object3165:head, will try copies on 2,4 2024-04-20T02:24:57.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.148+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:24:57.169 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.169+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acc05557:::benchmark_data_smithi171_44355_object7:head, will try copies on 0,4 2024-04-20T02:24:57.207 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.207+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:24:57.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.223+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:24:57.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.242+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:24:57.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.250+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:24:57.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.257+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:24:57.258 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.258+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:24:57.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.293+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:24:57.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.299+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:24:57.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.307+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:24:57.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.317+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:57.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.346+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:24:57.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.354+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:24:57.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.361+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:24:57.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.381+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:57.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.388+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:24:57.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.401+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:24:57.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.461+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:24:57.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.467+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:24:57.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.517+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6d8177e:::benchmark_data_smithi171_44355_object3495:head, will try copies on 2,4 2024-04-20T02:24:57.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.549+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:24:57.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 321 15 4600511 4600496 895.634 900.938 0.00119316 0.00110204 2024-04-20T02:24:57.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.556+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:57.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.590+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:24:57.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.593+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:24:57.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.630+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:57.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.659+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:24:57.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:24:57.684 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:24:57.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.693+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c234e473:::benchmark_data_smithi171_44355_object3506:head, will try copies on 2,4 2024-04-20T02:24:57.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.702+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:24:57.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.729+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:24:57.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.732+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:57.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:24:57.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.755+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:24:57.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.798+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:24:57.805 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.805+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:24:57.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.811+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34aa614:::benchmark_data_smithi171_44355_object3381:head, will try copies on 0,4 2024-04-20T02:24:57.816 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.816+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4af81bc:::benchmark_data_smithi171_44355_object160:head, will try copies on 0,4 2024-04-20T02:24:57.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.845+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:24:57.865 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.865+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:24:57.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.873+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:24:57.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.927+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:24:57.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.930+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:24:57.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.953+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:24:57.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.954+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:24:57.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:57.966+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c138e954:::benchmark_data_smithi171_44355_object2055:head, will try copies on 2,4 2024-04-20T02:24:58.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.013+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:24:58.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.029+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:24:58.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.062+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:58.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.087+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:24:58.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.100+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:24:58.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.109+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:24:58.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.115+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22d51a9:::benchmark_data_smithi171_44355_object378:head, will try copies on 2,4 2024-04-20T02:24:58.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.160+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:24:58.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.179+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:24:58.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.215+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:24:58.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.230+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:24:58.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.230+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:24:58.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.241+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:24:58.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.262+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:24:58.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.270+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:24:58.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.298+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:24:58.330 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:24:58.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.337+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:24:58.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.351+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:24:58.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.388+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1dd2de9:::benchmark_data_smithi171_44355_object3649:head, will try copies on 0,4 2024-04-20T02:24:58.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.394+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:24:58.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.411+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:24:58.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.436+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:24:58.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.441+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:24:58.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.494+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:24:58.520 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.520+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:24:58.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.545+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:24:58.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.549+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:24:58.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 322 16 4614776 4614760 895.621 891.5 0.000690802 0.00110206 2024-04-20T02:24:58.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.569+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:24:58.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.595+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:24:58.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.595+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:24:58.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.619+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:24:58.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.643+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:24:58.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.651+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:24:58.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.656+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cff1a6:::benchmark_data_smithi171_44355_object1601:head, will try copies on 2,4 2024-04-20T02:24:58.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.694+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:24:58.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.695+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:24:58.747 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.747+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:24:58.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.768+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:24:58.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.782+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:24:58.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.782+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:24:58.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.868+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:24:58.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.892+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:24:58.897 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.896+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:24:58.901 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:24:58.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:24:58.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.961+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:24:58.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:24:58.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:58.979+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:24:59.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:24:59.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.019+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:24:59.038 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.037+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:24:59.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.043+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8a16eb:::benchmark_data_smithi171_44355_object2214:head, will try copies on 0,4 2024-04-20T02:24:59.080 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.080+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:24:59.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.094+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:24:59.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.095+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:24:59.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:24:59.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.106+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:24:59.148 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.147+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:24:59.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.158+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:24:59.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.176+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:59.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.184+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:24:59.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.222+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:24:59.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.230+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:24:59.282 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.281+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:24:59.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.317+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:24:59.345 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.344+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:24:59.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.346+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:24:59.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.354+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:24:59.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.366+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:24:59.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.410+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:24:59.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.426+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:24:59.431 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.431+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:24:59.453 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.453+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:24:59.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.472+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6bd6d77:::benchmark_data_smithi171_44355_object2565:head, will try copies on 0,4 2024-04-20T02:24:59.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.473+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:24:59.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.495+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:24:59.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.512+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:24:59.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.535+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:24:59.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 323 15 4629213 4629198 895.641 902.375 0.000952836 0.00110204 2024-04-20T02:24:59.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.560+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:24:59.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.592+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:24:59.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.607+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:24:59.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.618+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:24:59.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.657+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:24:59.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.678+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:24:59.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.681+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:24:59.701 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.701+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:24:59.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.730+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:24:59.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.731+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:24:59.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:24:59.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.791+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:24:59.825 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.825+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:24:59.875 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.875+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:24:59.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.910+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:24:59.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.936+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:24:59.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.961+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:24:59.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:24:59.964+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:25:00.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.012+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:25:00.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.018+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:25:00.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a88b82b7:::benchmark_data_smithi171_44355_object4319:head, will try copies on 0,4 2024-04-20T02:25:00.037 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.037+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:25:00.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.112+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:25:00.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.114+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:25:00.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.128+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb577e9:::benchmark_data_smithi171_44355_object2898:head, will try copies on 0,4 2024-04-20T02:25:00.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.153+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:25:00.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.157+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:25:00.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.193+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:25:00.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.217+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:25:00.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.233+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:25:00.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.243+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:25:00.252 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.251+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:25:00.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.277+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:25:00.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.299+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:25:00.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.315+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e020f064:::benchmark_data_smithi171_44355_object3847:head, will try copies on 0,4 2024-04-20T02:25:00.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:25:00.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.409+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:25:00.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.414+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:25:00.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.422+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:25:00.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.428+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edb1f05c:::benchmark_data_smithi171_44355_object2680:head, will try copies on 0,4 2024-04-20T02:25:00.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.457+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:25:00.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.460+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:25:00.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.471+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:25:00.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.491+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:25:00.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.505+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:25:00.519 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.519+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:25:00.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:25:00.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 324 16 4642420 4642404 895.424 825.375 0.000959277 0.00110231 2024-04-20T02:25:00.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.562+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:25:00.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.565+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:25:00.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.573+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:25:00.585 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.585+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:00.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.608+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:25:00.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.610+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:25:00.620 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.619+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:25:00.637 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.637+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:25:00.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.680+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:25:00.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:25:00.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.706+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:25:00.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.712+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:25:00.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.730+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:25:00.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:25:00.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.755+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:25:00.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.763+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:25:00.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:25:00.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.818+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:25:00.826 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.826+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:25:00.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.834+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:25:00.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.867+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:25:00.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:25:00.896 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.896+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:25:00.904 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.904+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:25:00.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.913+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:25:00.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:25:00.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.945+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:25:00.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.946+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:00.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.982+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:25:00.988 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:00.988+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:25:01.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.027+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:25:01.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.054+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:25:01.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.078+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:25:01.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.092+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:25:01.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.105+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8a3862d:::benchmark_data_smithi171_44355_object2720:head, will try copies on 2,4 2024-04-20T02:25:01.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.106+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:25:01.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.127+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:25:01.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.141+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:25:01.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.143+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:25:01.165 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.164+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:caf7efc4:::benchmark_data_smithi171_44355_object2745:head, will try copies on 2,4 2024-04-20T02:25:01.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.179+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:25:01.209 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.209+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:25:01.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.212+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:25:01.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.247+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:25:01.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.260+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:25:01.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.261+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:25:01.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.274+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:25:01.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.296+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:25:01.315 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.315+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:25:01.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.322+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:25:01.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.335+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:25:01.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.344+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:25:01.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.353+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:25:01.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.371+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:25:01.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:25:01.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.408+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:25:01.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.411+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:25:01.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.438+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fd1c58:::benchmark_data_smithi171_44355_object729:head, will try copies on 0,4 2024-04-20T02:25:01.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.458+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:25:01.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.465+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:25:01.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.476+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:01.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.481+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:25:01.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.485+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:25:01.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.496+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:25:01.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.509+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:25:01.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.528+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:25:01.548 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.548+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:25:01.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.551+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:25:01.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 325 16 4656588 4656572 895.393 885.5 0.00067361 0.00110234 2024-04-20T02:25:01.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.572+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:25:01.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.575+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:25:01.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.605+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:25:01.624 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.624+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1bcc793:::benchmark_data_smithi171_44355_object3594:head, will try copies on 0,4 2024-04-20T02:25:01.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.640+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:25:01.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.644+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:01.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:25:01.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8265db7:::benchmark_data_smithi171_44355_object2121:head, will try copies on 0,4 2024-04-20T02:25:01.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.703+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:25:01.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.715+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:25:01.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.720+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:25:01.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.739+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:25:01.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:25:01.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.747+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:25:01.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.761+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:25:01.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.777+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:25:01.792 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.792+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:25:01.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.802+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:25:01.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.806+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:25:01.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.818+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:25:01.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.852+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:25:01.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.852+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:25:01.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.858+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:25:01.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.878+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:25:01.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.883+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:25:01.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.942+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:25:01.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.990+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:25:01.996 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:01.996+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:25:02.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.005+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:25:02.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.012+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:25:02.053 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.052+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:25:02.076 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.075+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:25:02.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.096+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:25:02.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.105+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:25:02.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.121+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:02.125 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.125+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:25:02.145 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.145+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:25:02.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.219+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:25:02.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.236+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca6d9ad:::benchmark_data_smithi171_44355_object371:head, will try copies on 2,4 2024-04-20T02:25:02.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.248+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:25:02.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.249+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:25:02.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.286+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:25:02.295 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.295+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:25:02.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.313+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:25:02.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.330+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:25:02.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.366+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:25:02.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.406+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:25:02.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.411+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:25:02.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:25:02.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.432+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c39f43:::benchmark_data_smithi171_44355_object2652:head, will try copies on 0,4 2024-04-20T02:25:02.473 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.473+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:25:02.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:25:02.491 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:25:02.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.516+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:25:02.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.534+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aacd7807:::benchmark_data_smithi171_44355_object2553:head, will try copies on 0,4 2024-04-20T02:25:02.552 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.552+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:25:02.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 326 16 4671256 4671240 895.459 916.75 0.00103424 0.00110226 2024-04-20T02:25:02.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:25:02.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.574+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:25:02.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.574+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:25:02.578 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.578+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:25:02.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.611+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:25:02.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.638+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:25:02.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.672+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:25:02.672 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.672+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:25:02.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.695+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:25:02.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.702+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:25:02.712 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.711+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:25:02.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.724+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:25:02.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.737+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:25:02.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.785+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:25:02.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.798+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:25:02.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.802+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:25:02.819 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.819+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a963814f:::benchmark_data_smithi171_44355_object2999:head, will try copies on 0,4 2024-04-20T02:25:02.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.835+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:25:02.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.849+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:25:02.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.887+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e944110c:::benchmark_data_smithi171_44355_object1992:head, will try copies on 0,4 2024-04-20T02:25:02.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.898+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:02.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.910+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:25:02.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.922+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:25:02.946 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.945+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad462262:::benchmark_data_smithi171_44355_object2345:head, will try copies on 0,4 2024-04-20T02:25:02.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.958+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:25:02.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.965+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:25:02.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:02.991+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:25:03.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.001+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:25:03.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.033+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:25:03.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.048+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:25:03.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.058+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:25:03.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.068+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:25:03.075 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.075+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:25:03.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.094+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:25:03.105 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.105+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:25:03.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.140+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:25:03.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.169+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2641c31:::benchmark_data_smithi171_44355_object2702:head, will try copies on 2,4 2024-04-20T02:25:03.190 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.189+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:25:03.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.200+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:25:03.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.213+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:03.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.236+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:25:03.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.253+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:25:03.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.278+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:25:03.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.301+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:25:03.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.316+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:25:03.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.359+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:25:03.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.390+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:25:03.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.412+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:25:03.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.428+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:25:03.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.476+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edef6cf2:::benchmark_data_smithi171_44355_object4293:head, will try copies on 0,4 2024-04-20T02:25:03.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.479+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40c160b:::benchmark_data_smithi171_44355_object1237:head, will try copies on 2,4 2024-04-20T02:25:03.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.490+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:25:03.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.503+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:25:03.528 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.527+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:25:03.541 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.540+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:25:03.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.546+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:25:03.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 327 16 4685355 4685339 895.415 881.188 0.000420193 0.00110232 2024-04-20T02:25:03.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.558+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:25:03.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.613+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:25:03.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.623+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:25:03.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.653+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:25:03.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.664+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:25:03.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.674+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:25:03.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.703+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:25:03.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:25:03.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.749+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:25:03.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.810+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:25:03.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.823+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:25:03.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.844+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:25:03.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.864+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:25:03.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.901+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:25:03.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:25:03.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.930+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:03.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.948+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee8a2ff0:::benchmark_data_smithi171_44355_object1985:head, will try copies on 0,4 2024-04-20T02:25:03.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.965+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:25:03.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.971+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:25:03.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:03.999+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:25:04.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.027+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:25:04.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.039+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:25:04.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.072+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:25:04.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.074+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:25:04.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.118+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:25:04.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.128+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:25:04.166 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.165+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:25:04.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.192+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:25:04.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.228+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:25:04.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.253+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:25:04.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.254+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:25:04.279 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.279+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:25:04.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.283+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:25:04.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.288+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:25:04.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.297+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:04.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.333+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:25:04.346 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.345+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:25:04.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.349+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:25:04.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.375+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:25:04.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:25:04.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.390+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:25:04.403 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.402+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:25:04.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.427+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:25:04.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.438+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:25:04.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.441+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:25:04.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.468+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:25:04.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.483+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:25:04.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.499+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a407a4b9:::benchmark_data_smithi171_44355_object2844:head, will try copies on 0,4 2024-04-20T02:25:04.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:25:04.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.537+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:25:04.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 328 15 4699978 4699963 895.471 914 0.00147411 0.00110225 2024-04-20T02:25:04.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.570+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:25:04.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.575+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:25:04.583 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.582+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e13105:::benchmark_data_smithi171_44355_object4102:head, will try copies on 2,4 2024-04-20T02:25:04.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.607+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:25:04.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.612+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:25:04.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.628+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:25:04.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.674+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:25:04.692 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.691+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d412e9:::benchmark_data_smithi171_44355_object3784:head, will try copies on 2,4 2024-04-20T02:25:04.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.710+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:25:04.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.719+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:25:04.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.726+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:04.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.744+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:25:04.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.750+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:25:04.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.761+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:25:04.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:25:04.817 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.817+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:25:04.852 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.852+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:25:04.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622b3e:::benchmark_data_smithi171_44355_object3360:head, will try copies on 0,4 2024-04-20T02:25:04.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.900+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:25:04.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.910+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:25:04.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.914+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:25:04.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.939+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:25:04.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:04.994+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:25:05.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.000+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:25:05.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.072+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:25:05.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.103+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:25:05.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.119+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:25:05.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.156+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:25:05.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.168+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf93a211:::benchmark_data_smithi171_44355_object82:head, will try copies on 2,4 2024-04-20T02:25:05.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.175+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:05.181 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.180+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add402a1:::benchmark_data_smithi171_44355_object263:head, will try copies on 0,4 2024-04-20T02:25:05.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.201+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:25:05.208 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.208+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:25:05.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.227+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34489d3:::benchmark_data_smithi171_44355_object75:head, will try copies on 2,4 2024-04-20T02:25:05.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.228+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:25:05.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.267+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:25:05.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.277+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:25:05.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:25:05.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.304+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:25:05.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.331+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:25:05.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.382+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:25:05.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.394+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:25:05.395 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.394+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:25:05.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.421+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:25:05.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:25:05.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.475+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:25:05.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.498+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:25:05.512 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.512+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:25:05.554 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.553+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9c68dc:::benchmark_data_smithi171_44355_object1811:head, will try copies on 2,4 2024-04-20T02:25:05.555 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 329 16 4713530 4713514 895.323 846.938 0.000777824 0.00110244 2024-04-20T02:25:05.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.563+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:25:05.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.584+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:25:05.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.639+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:25:05.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.642+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54de211:::benchmark_data_smithi171_44355_object3957:head, will try copies on 0,4 2024-04-20T02:25:05.662 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.662+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc454124:::benchmark_data_smithi171_44355_object1364:head, will try copies on 2,4 2024-04-20T02:25:05.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.678+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:25:05.697 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.696+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:25:05.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.721+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:25:05.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.722+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8c6c27:::benchmark_data_smithi171_44355_object402:head, will try copies on 0,4 2024-04-20T02:25:05.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.738+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:25:05.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.758+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:25:05.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.785+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:25:05.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.795+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c23a19cb:::benchmark_data_smithi171_44355_object2381:head, will try copies on 2,4 2024-04-20T02:25:05.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.808+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:25:05.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.813+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:25:05.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.820+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3aa8400:::benchmark_data_smithi171_44355_object2181:head, will try copies on 2,4 2024-04-20T02:25:05.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.836+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:25:05.857 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.857+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:25:05.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.858+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7ac93a1:::benchmark_data_smithi171_44355_object1537:head, will try copies on 0,4 2024-04-20T02:25:05.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.877+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:25:05.885 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.885+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:25:05.919 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.919+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:25:05.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.928+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:25:05.949 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.949+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:25:05.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.954+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:25:05.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.964+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:05.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.969+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:25:05.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:05.993+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:25:06.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.034+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:25:06.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.046+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:25:06.082 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.082+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1afcd:::benchmark_data_smithi171_44355_object122:head, will try copies on 0,4 2024-04-20T02:25:06.091 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.091+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:25:06.194 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.194+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:25:06.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.249+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:25:06.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.267+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:25:06.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.322+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a479b00f:::benchmark_data_smithi171_44355_object366:head, will try copies on 0,4 2024-04-20T02:25:06.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.353+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:25:06.377 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.376+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:25:06.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.389+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:25:06.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.397+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:25:06.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.417+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9062fd6:::benchmark_data_smithi171_44355_object696:head, will try copies on 0,4 2024-04-20T02:25:06.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.437+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:25:06.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.444+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:25:06.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.466+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:25:06.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.477+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ac125:::benchmark_data_smithi171_44355_object1108:head, will try copies on 2,4 2024-04-20T02:25:06.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:25:06.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.511+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:25:06.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.549+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:25:06.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 330 16 4728305 4728289 895.408 923.438 0.00096576 0.00110233 2024-04-20T02:25:06.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.596+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:25:06.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.603+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:25:06.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.604+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:25:06.655 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.654+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:25:06.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.660+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:25:06.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.694+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:25:06.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.709+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:25:06.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.723+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:25:06.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:25:06.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.762+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:25:06.771 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.771+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:25:06.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.802+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed23f191:::benchmark_data_smithi171_44355_object2822:head, will try copies on 0,4 2024-04-20T02:25:06.818 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.818+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:25:06.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.844+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cded0c3b:::benchmark_data_smithi171_44355_object585:head, will try copies on 2,4 2024-04-20T02:25:06.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.853+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e412b2b9:::benchmark_data_smithi171_44355_object3811:head, will try copies on 0,4 2024-04-20T02:25:06.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.860+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:25:06.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.861+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:25:06.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.871+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:25:06.892 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.891+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:25:06.903 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.901+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:25:06.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.923+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:25:06.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.936+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:25:06.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.938+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:25:06.950 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.950+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:25:06.963 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.962+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:25:06.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.980+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:25:06.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:06.990+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:25:07.007 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.006+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee30b55f:::benchmark_data_smithi171_44355_object3844:head, will try copies on 0,4 2024-04-20T02:25:07.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.010+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:25:07.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.023+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:25:07.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.035+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:25:07.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.040+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:25:07.051 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.050+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:25:07.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.059+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:25:07.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.069+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:25:07.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.122+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f983b2:::benchmark_data_smithi171_44355_object1417:head, will try copies on 2,4 2024-04-20T02:25:07.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:25:07.153 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.152+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4734965:::benchmark_data_smithi171_44355_object3161:head, will try copies on 0,4 2024-04-20T02:25:07.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.168+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:25:07.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.187+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:25:07.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.211+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:25:07.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:25:07.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.238+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:25:07.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.242+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:25:07.296 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.295+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:25:07.308 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.307+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:25:07.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.325+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:25:07.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.343+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:25:07.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.351+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:25:07.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.366+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:25:07.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.371+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:25:07.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.386+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6985bc:::benchmark_data_smithi171_44355_object3105:head, will try copies on 0,4 2024-04-20T02:25:07.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.408+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:25:07.423 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.422+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:25:07.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.458+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:25:07.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.475+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:25:07.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.485+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:25:07.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.486+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:25:07.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.500+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:25:07.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.511+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:07.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.529+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:25:07.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 331 16 4742759 4742743 895.432 903.375 0.000812692 0.0011023 2024-04-20T02:25:07.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.561+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:25:07.565 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.563+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:25:07.597 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:25:07.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.606+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c94d81e7:::benchmark_data_smithi171_44355_object460:head, will try copies on 2,4 2024-04-20T02:25:07.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.641+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:25:07.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.643+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:25:07.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.653+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:25:07.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.659+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:25:07.661 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.661+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:07.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.678+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:25:07.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.707+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:25:07.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.716+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca17ec24:::benchmark_data_smithi171_44355_object2528:head, will try copies on 2,4 2024-04-20T02:25:07.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.722+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:25:07.723 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.723+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:25:07.759 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.758+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:07.761 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.760+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0b0b84:::benchmark_data_smithi171_44355_object2615:head, will try copies on 0,4 2024-04-20T02:25:07.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.767+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:25:07.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.788+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c10958b8:::benchmark_data_smithi171_44355_object1523:head, will try copies on 2,4 2024-04-20T02:25:07.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.799+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:25:07.811 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.811+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdfdc8e0:::benchmark_data_smithi171_44355_object1535:head, will try copies on 2,4 2024-04-20T02:25:07.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.812+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:25:07.838 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.837+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:25:07.853 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.853+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:25:07.869 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.868+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:25:07.890 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.889+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:25:07.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.893+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:25:07.959 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.958+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:25:07.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.966+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:25:07.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.968+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:25:07.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab385727:::benchmark_data_smithi171_44355_object771:head, will try copies on 0,4 2024-04-20T02:25:07.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:07.984+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:25:08.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.003+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:25:08.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.020+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:25:08.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.039+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:25:08.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.059+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:25:08.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.067+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:25:08.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.085+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:25:08.093 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.092+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:08.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.100+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:25:08.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.121+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:25:08.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.130+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:25:08.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25efa5b:::benchmark_data_smithi171_44355_object1684:head, will try copies on 0,4 2024-04-20T02:25:08.158 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.158+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:25:08.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.159+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:25:08.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.182+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:25:08.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.203+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:25:08.219 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.218+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:25:08.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.230+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:25:08.277 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.276+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:25:08.298 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.297+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:25:08.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.316+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:25:08.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.321+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:25:08.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.343+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5352a08:::benchmark_data_smithi171_44355_object3054:head, will try copies on 0,4 2024-04-20T02:25:08.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.352+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c238918b:::benchmark_data_smithi171_44355_object955:head, will try copies on 2,4 2024-04-20T02:25:08.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.357+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:25:08.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.368+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:25:08.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.385+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:25:08.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.408+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:25:08.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5fb0508:::benchmark_data_smithi171_44355_object1258:head, will try copies on 0,4 2024-04-20T02:25:08.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:25:08.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.472+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:25:08.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.502+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:25:08.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.509+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:25:08.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:25:08.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.531+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:25:08.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 332 16 4756953 4756937 895.407 887.125 0.000683779 0.00110233 2024-04-20T02:25:08.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.558+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:25:08.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.569+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:25:08.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.647+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:25:08.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.670+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a301e956:::benchmark_data_smithi171_44355_object763:head, will try copies on 0,4 2024-04-20T02:25:08.675 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.675+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2046bb7:::benchmark_data_smithi171_44355_object3118:head, will try copies on 0,4 2024-04-20T02:25:08.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.714+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:25:08.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:08.726 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.726+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2c9c090:::benchmark_data_smithi171_44355_object639:head, will try copies on 0,4 2024-04-20T02:25:08.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.728+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:25:08.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.754+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e10fb002:::benchmark_data_smithi171_44355_object2364:head, will try copies on 0,4 2024-04-20T02:25:08.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.777+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:25:08.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.801+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:25:08.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.819+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:25:08.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.830+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:25:08.846 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.845+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:25:08.889 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.888+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:25:08.909 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:25:08.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.921+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:25:08.932 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.931+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff51296:::benchmark_data_smithi171_44355_object2498:head, will try copies on 2,4 2024-04-20T02:25:08.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.958+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26f3ee2:::benchmark_data_smithi171_44355_object934:head, will try copies on 0,4 2024-04-20T02:25:08.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:08.977+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:25:09.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:25:09.048 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.047+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:25:09.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.057+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:09.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.059+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e108aba3:::benchmark_data_smithi171_44355_object1408:head, will try copies on 0,4 2024-04-20T02:25:09.077 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.076+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:25:09.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.082+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:25:09.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.112+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:09.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.123+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:25:09.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.128+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:25:09.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.131+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:25:09.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.141+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:25:09.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.157+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:25:09.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.171+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:25:09.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.193+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:25:09.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.205+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afea6bd3:::benchmark_data_smithi171_44355_object3299:head, will try copies on 0,4 2024-04-20T02:25:09.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.222+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:25:09.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.264+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:25:09.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.297+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:25:09.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.317+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:25:09.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.325+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:25:09.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.348+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:25:09.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.349+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:25:09.371 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.371+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:25:09.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.373+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:25:09.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.389+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:09.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.421+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:25:09.426 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.426+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3f1d7c4:::benchmark_data_smithi171_44355_object1983:head, will try copies on 2,4 2024-04-20T02:25:09.441 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.440+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:25:09.459 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.459+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:25:09.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.488+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:25:09.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.505+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:09.527 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.527+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:25:09.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.533+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a916d80e:::benchmark_data_smithi171_44355_object2274:head, will try copies on 0,4 2024-04-20T02:25:09.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.542+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:25:09.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 333 16 4771560 4771544 895.459 912.938 0.000775076 0.00110226 2024-04-20T02:25:09.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.559+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:25:09.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.571+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:25:09.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.584+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:25:09.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.602+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:25:09.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.636+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:25:09.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.650+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:25:09.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.672+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:25:09.681 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.681+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:25:09.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.731+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1ae2ef:::benchmark_data_smithi171_44355_object2836:head, will try copies on 2,4 2024-04-20T02:25:09.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.744+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:25:09.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.787+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:09.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.813+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:25:09.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.873+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:25:09.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.910+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:25:09.914 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.914+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:25:09.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.927+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a82a9896:::benchmark_data_smithi171_44355_object257:head, will try copies on 0,4 2024-04-20T02:25:09.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.928+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:25:09.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.960+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:25:09.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.982+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:25:09.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:09.988+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c05f9bb0:::benchmark_data_smithi171_44355_object582:head, will try copies on 2,4 2024-04-20T02:25:10.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.015+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:25:10.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.022+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:25:10.032 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.033+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:25:10.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.043+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:25:10.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.097+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:25:10.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.098+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:25:10.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.112+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:25:10.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.165+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:25:10.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.181+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:25:10.227 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.227+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:25:10.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.251+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:25:10.265 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.265+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:25:10.287 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.288+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:25:10.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.306+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:25:10.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.311+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:25:10.318 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.318+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:25:10.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.336+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:25:10.340 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.341+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edacfbdc:::benchmark_data_smithi171_44355_object3110:head, will try copies on 0,4 2024-04-20T02:25:10.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:25:10.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.364+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:25:10.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.388+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24dd928:::benchmark_data_smithi171_44355_object2636:head, will try copies on 0,4 2024-04-20T02:25:10.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.388+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:10.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.421+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c560db74:::benchmark_data_smithi171_44355_object1039:head, will try copies on 2,4 2024-04-20T02:25:10.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.439+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:25:10.443 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.443+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:25:10.457 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.458+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab629a8d:::benchmark_data_smithi171_44355_object1495:head, will try copies on 0,4 2024-04-20T02:25:10.466 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.466+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:25:10.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.517+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbf21c99:::benchmark_data_smithi171_44355_object3006:head, will try copies on 2,4 2024-04-20T02:25:10.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.532+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fa254e:::benchmark_data_smithi171_44355_object3401:head, will try copies on 0,4 2024-04-20T02:25:10.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.532+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:25:10.543 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.544+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:25:10.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 334 16 4785613 4785597 895.408 878.312 0.00108266 0.00110232 2024-04-20T02:25:10.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.591+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:25:10.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.628+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:25:10.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.636+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:25:10.639 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.640+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:25:10.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.689+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1002407:::benchmark_data_smithi171_44355_object387:head, will try copies on 0,4 2024-04-20T02:25:10.732 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.732+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:25:10.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.735+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:25:10.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:25:10.763 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.763+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:25:10.780 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.781+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:25:10.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.786+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:25:10.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.803+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49f1429:::benchmark_data_smithi171_44355_object2050:head, will try copies on 2,4 2024-04-20T02:25:10.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.813+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:25:10.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.832+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:25:10.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.842+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:25:10.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.851+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:25:10.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.852+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:25:10.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.908+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2c6b0a3:::benchmark_data_smithi171_44355_object3790:head, will try copies on 2,4 2024-04-20T02:25:10.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.918+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:25:10.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:25:10.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.944+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:25:10.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.948+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:25:10.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.976+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:25:10.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:10.977+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac4d9ed3:::benchmark_data_smithi171_44355_object1094:head, will try copies on 0,4 2024-04-20T02:25:11.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.003+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:25:11.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.008+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:25:11.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.017+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:25:11.044 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.044+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:25:11.078 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.079+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:25:11.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.080+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:25:11.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.106+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:25:11.111 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.112+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:25:11.139 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.139+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:25:11.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.151+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:25:11.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.217+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:25:11.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.235+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:25:11.253 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.253+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:25:11.269 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.270+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7b4055e:::benchmark_data_smithi171_44355_object1454:head, will try copies on 2,4 2024-04-20T02:25:11.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.283+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:25:11.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.290+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:25:11.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.293+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:25:11.321 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.322+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a33d43e0:::benchmark_data_smithi171_44355_object3034:head, will try copies on 0,4 2024-04-20T02:25:11.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.336+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:25:11.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.349+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:25:11.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.370+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:25:11.378 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:25:11.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.403+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:25:11.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.403+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c21557fa:::benchmark_data_smithi171_44355_object1798:head, will try copies on 2,4 2024-04-20T02:25:11.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.407+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a690f469:::benchmark_data_smithi171_44355_object3063:head, will try copies on 0,4 2024-04-20T02:25:11.447 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.448+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:25:11.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.464+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf8ec68:::benchmark_data_smithi171_44355_object849:head, will try copies on 0,4 2024-04-20T02:25:11.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:25:11.502 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.502+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:25:11.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.513+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:25:11.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.530+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1875bf6:::benchmark_data_smithi171_44355_object3437:head, will try copies on 0,4 2024-04-20T02:25:11.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 335 16 4800091 4800075 895.435 904.875 0.00135702 0.00110229 2024-04-20T02:25:11.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.572+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:25:11.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.576+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:25:11.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.595+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:25:11.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.600+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:25:11.625 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.625+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:25:11.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.652+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e08c563d:::benchmark_data_smithi171_44355_object3048:head, will try copies on 0,4 2024-04-20T02:25:11.683 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.683+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:25:11.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.691+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:25:11.708 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.708+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:11.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.722+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe9b610:::benchmark_data_smithi171_44355_object3384:head, will try copies on 0,4 2024-04-20T02:25:11.725 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.725+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:25:11.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.744+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:25:11.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.753+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:25:11.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.769+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:25:11.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.772+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea73cbdb:::benchmark_data_smithi171_44355_object2215:head, will try copies on 0,4 2024-04-20T02:25:11.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.794+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:25:11.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.802+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acd354e9:::benchmark_data_smithi171_44355_object867:head, will try copies on 0,4 2024-04-20T02:25:11.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.841+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:25:11.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.844+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:25:11.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.862+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:25:11.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.868+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c1009d:::benchmark_data_smithi171_44355_object4217:head, will try copies on 0,4 2024-04-20T02:25:11.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.875+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:25:11.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.907+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:25:11.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.911+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea75bdef:::benchmark_data_smithi171_44355_object1144:head, will try copies on 0,4 2024-04-20T02:25:11.925 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.925+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:25:11.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.926+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:25:11.969 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:11.970+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3757cc:::benchmark_data_smithi171_44355_object148:head, will try copies on 0,4 2024-04-20T02:25:12.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.007+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:25:12.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.014+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:25:12.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.068+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:25:12.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.087+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:25:12.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.103+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:25:12.129 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.130+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:25:12.132 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.132+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:25:12.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.139+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:25:12.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.162+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:12.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.165+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:25:12.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.195+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49216c3:::benchmark_data_smithi171_44355_object498:head, will try copies on 2,4 2024-04-20T02:25:12.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.215+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:25:12.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.232+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4849074:::benchmark_data_smithi171_44355_object592:head, will try copies on 2,4 2024-04-20T02:25:12.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.239+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:25:12.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.249+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce2ac1c2:::benchmark_data_smithi171_44355_object3698:head, will try copies on 2,4 2024-04-20T02:25:12.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.258+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:25:12.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.270+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:25:12.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.292+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:25:12.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.306+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:25:12.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.328+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8ffbbff:::benchmark_data_smithi171_44355_object1215:head, will try copies on 0,4 2024-04-20T02:25:12.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.390+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:25:12.396 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.396+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:25:12.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.413+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e05762b0:::benchmark_data_smithi171_44355_object2942:head, will try copies on 0,4 2024-04-20T02:25:12.448 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.448+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:25:12.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.476+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:25:12.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.485+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:25:12.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.496+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:25:12.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.509+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:25:12.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.511+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:25:12.535 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.536+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:25:12.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.545+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:25:12.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.547+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:25:12.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 336 16 4814563 4814547 895.462 904.5 0.000720444 0.00110225 2024-04-20T02:25:12.611 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.612+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:25:12.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.640+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e941bb3a:::benchmark_data_smithi171_44355_object2739:head, will try copies on 0,4 2024-04-20T02:25:12.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.643+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:25:12.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.666+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:25:12.680 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.680+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:25:12.694 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.694+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:25:12.720 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.721+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:25:12.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:25:12.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:25:12.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.752+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:25:12.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.788+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:25:12.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.789+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:25:12.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.864+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:25:12.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.878+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:25:12.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.908+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:25:12.908 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.909+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:12.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.922+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a56727fa:::benchmark_data_smithi171_44355_object507:head, will try copies on 0,4 2024-04-20T02:25:12.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:12.962+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:25:13.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.010+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:25:13.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.027+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:13.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.030+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:25:13.092 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.093+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cae4fbd7:::benchmark_data_smithi171_44355_object412:head, will try copies on 2,4 2024-04-20T02:25:13.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.110+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:25:13.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.111+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:25:13.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.136+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:25:13.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.143+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:25:13.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.164+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:13.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.182+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dfb305:::benchmark_data_smithi171_44355_object830:head, will try copies on 0,4 2024-04-20T02:25:13.191 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.192+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:25:13.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.214+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:25:13.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.232+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:25:13.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.232+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:25:13.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.233+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:25:13.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.249+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9b83f65:::benchmark_data_smithi171_44355_object746:head, will try copies on 0,4 2024-04-20T02:25:13.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.277+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:25:13.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.318+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:25:13.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.352+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:25:13.366 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.367+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:25:13.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.367+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:25:13.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.398+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84a90bd:::benchmark_data_smithi171_44355_object1820:head, will try copies on 0,4 2024-04-20T02:25:13.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.402+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:25:13.420 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:25:13.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.450+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:25:13.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:25:13.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.508+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:25:13.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.518+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:25:13.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.537+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:25:13.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.548+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acaad0f9:::benchmark_data_smithi171_44355_object1723:head, will try copies on 0,4 2024-04-20T02:25:13.556 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 337 16 4827682 4827666 895.238 819.938 0.000895409 0.00110254 2024-04-20T02:25:13.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.587+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:25:13.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:25:13.614 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.615+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:25:13.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.632+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:25:13.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.652+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:25:13.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.660+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:13.674 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.675+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4985c06:::benchmark_data_smithi171_44355_object3140:head, will try copies on 2,4 2024-04-20T02:25:13.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.703+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:25:13.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.729+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:25:13.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.741+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:25:13.751 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c4903b:::benchmark_data_smithi171_44355_object3541:head, will try copies on 0,4 2024-04-20T02:25:13.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.772+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:25:13.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.776+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:25:13.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.802+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:25:13.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.822+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:25:13.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.844+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:25:13.847 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.848+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:25:13.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.863+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:25:13.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.869+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:25:13.899 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.900+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:25:13.902 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.903+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:25:13.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.940+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc582364:::benchmark_data_smithi171_44355_object3638:head, will try copies on 2,4 2024-04-20T02:25:13.954 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.955+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:25:13.981 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.981+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c2d540:::benchmark_data_smithi171_44355_object4033:head, will try copies on 0,4 2024-04-20T02:25:13.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:13.999+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c53dcb1b:::benchmark_data_smithi171_44355_object3929:head, will try copies on 2,4 2024-04-20T02:25:14.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.011+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:25:14.024 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.024+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:25:14.057 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.058+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:14.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.082+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:25:14.136 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.136+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:25:14.144 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.145+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:25:14.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.151+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:25:14.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.172+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:25:14.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.176+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a455afa1:::benchmark_data_smithi171_44355_object406:head, will try copies on 0,4 2024-04-20T02:25:14.211 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.211+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0386a96:::benchmark_data_smithi171_44355_object1027:head, will try copies on 2,4 2024-04-20T02:25:14.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.229+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7221161:::benchmark_data_smithi171_44355_object946:head, will try copies on 2,4 2024-04-20T02:25:14.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.230+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:25:14.235 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.236+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a256d25c:::benchmark_data_smithi171_44355_object1089:head, will try copies on 0,4 2024-04-20T02:25:14.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.258+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:25:14.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.268+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:25:14.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.284+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:25:14.286 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.287+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:25:14.306 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.304+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:25:14.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:25:14.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.341+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:25:14.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.351+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:25:14.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.354+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:25:14.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.375+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:25:14.390 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3406bb9:::benchmark_data_smithi171_44355_object1633:head, will try copies on 2,4 2024-04-20T02:25:14.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.400+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:25:14.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.415+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:25:14.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.422+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce6c24d2:::benchmark_data_smithi171_44355_object4238:head, will try copies on 2,4 2024-04-20T02:25:14.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.436+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:25:14.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:25:14.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.483+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:25:14.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.484+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:25:14.505 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.505+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:14.508 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.509+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:25:14.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.522+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:25:14.536 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.536+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:25:14.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.557+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:25:14.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 338 15 4842339 4842324 895.299 916.125 0.000667323 0.00110246 2024-04-20T02:25:14.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.568+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:25:14.572 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.572+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:14.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.601+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd1bb14:::benchmark_data_smithi171_44355_object1522:head, will try copies on 0,4 2024-04-20T02:25:14.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.628+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c31cfaeb:::benchmark_data_smithi171_44355_object2854:head, will try copies on 2,4 2024-04-20T02:25:14.679 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.680+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:25:14.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.693+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c65f5f2a:::benchmark_data_smithi171_44355_object1848:head, will try copies on 2,4 2024-04-20T02:25:14.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.735+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b04ca2:::benchmark_data_smithi171_44355_object2158:head, will try copies on 2,4 2024-04-20T02:25:14.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.740+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:25:14.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.754+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:25:14.755 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.756+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:25:14.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.778+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afaef2fe:::benchmark_data_smithi171_44355_object2243:head, will try copies on 0,4 2024-04-20T02:25:14.788 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.789+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:25:14.807 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.808+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:25:14.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.823+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed746e56:::benchmark_data_smithi171_44355_object4155:head, will try copies on 0,4 2024-04-20T02:25:14.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.829+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:25:14.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.842+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:25:14.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.843+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:25:14.858 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.858+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:25:14.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.861+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:25:14.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.881+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:25:14.911 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.911+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:25:14.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.962+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:25:14.962 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.963+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:25:14.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.966+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef2e2e43:::benchmark_data_smithi171_44355_object1030:head, will try copies on 0,4 2024-04-20T02:25:14.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.976+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:25:14.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:14.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:25:15.021 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.021+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:25:15.031 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.032+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6afaca:::benchmark_data_smithi171_44355_object2081:head, will try copies on 0,4 2024-04-20T02:25:15.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.039+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:25:15.063 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.064+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:25:15.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.067+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:25:15.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.072+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfb35653:::benchmark_data_smithi171_44355_object3432:head, will try copies on 2,4 2024-04-20T02:25:15.106 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.107+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:25:15.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.116+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:25:15.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.123+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:25:15.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.157+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:25:15.164 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.165+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:25:15.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.184+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4207f60:::benchmark_data_smithi171_44355_object2974:head, will try copies on 2,4 2024-04-20T02:25:15.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:25:15.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.213+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:25:15.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.235+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b6d7d4:::benchmark_data_smithi171_44355_object1400:head, will try copies on 0,4 2024-04-20T02:25:15.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.249+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:25:15.259 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.260+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:25:15.304 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.305+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:25:15.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.311+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:25:15.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:15.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.360+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:25:15.360 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.361+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:25:15.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.373+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:25:15.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.403+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:25:15.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.413+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:25:15.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.420+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:25:15.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.428+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a675e08c:::benchmark_data_smithi171_44355_object228:head, will try copies on 0,4 2024-04-20T02:25:15.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.441+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:25:15.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.445+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:25:15.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.452+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:25:15.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.466+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:25:15.494 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.494+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:25:15.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.508+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:25:15.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.517+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:15.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.525+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7dde32c:::benchmark_data_smithi171_44355_object2819:head, will try copies on 0,4 2024-04-20T02:25:15.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.531+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:15.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.557+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:25:15.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 339 16 4856697 4856681 895.305 897.312 0.000741057 0.00110246 2024-04-20T02:25:15.571 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.571+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:25:15.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.580+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:25:15.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:25:15.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.618+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:25:15.618 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.619+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab6f08fa:::benchmark_data_smithi171_44355_object2741:head, will try copies on 0,4 2024-04-20T02:25:15.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.670+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:25:15.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.719+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:25:15.721 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.722+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:25:15.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.725+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e919689e:::benchmark_data_smithi171_44355_object2546:head, will try copies on 0,4 2024-04-20T02:25:15.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.730+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:25:15.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.769+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:25:15.787 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.788+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:25:15.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.812+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:25:15.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.822+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efcff5d3:::benchmark_data_smithi171_44355_object637:head, will try copies on 0,4 2024-04-20T02:25:15.841 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.842+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e39ca114:::benchmark_data_smithi171_44355_object821:head, will try copies on 0,4 2024-04-20T02:25:15.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.848+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:25:15.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.872+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:15.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.874+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:25:15.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.894+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:25:15.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.895+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:25:15.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.901+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:25:15.934 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.935+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:25:15.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.977+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2741ff7:::benchmark_data_smithi171_44355_object1564:head, will try copies on 0,4 2024-04-20T02:25:15.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:15.994+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3086ab6:::benchmark_data_smithi171_44355_object132:head, will try copies on 0,4 2024-04-20T02:25:16.018 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.019+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:25:16.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.036+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c713df86:::benchmark_data_smithi171_44355_object1662:head, will try copies on 2,4 2024-04-20T02:25:16.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.060+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:25:16.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.067+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c40635f4:::benchmark_data_smithi171_44355_object1496:head, will try copies on 2,4 2024-04-20T02:25:16.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.080+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:25:16.100 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.100+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:25:16.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.103+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3f17c4c:::benchmark_data_smithi171_44355_object912:head, will try copies on 0,4 2024-04-20T02:25:16.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.131+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:25:16.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.147+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:16.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.152+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:25:16.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.219+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:25:16.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.237+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2491457:::benchmark_data_smithi171_44355_object2386:head, will try copies on 0,4 2024-04-20T02:25:16.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.239+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aff304f6:::benchmark_data_smithi171_44355_object25:head, will try copies on 0,4 2024-04-20T02:25:16.283 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.283+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:25:16.313 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.314+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:25:16.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.316+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:25:16.323 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.323+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:25:16.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.356+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:16.367 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.368+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:25:16.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.381+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a13f84e0:::benchmark_data_smithi171_44355_object1538:head, will try copies on 0,4 2024-04-20T02:25:16.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.394+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:25:16.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:25:16.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.439+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:25:16.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.456+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:25:16.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.464+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:25:16.480 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.480+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384aca0:::benchmark_data_smithi171_44355_object2349:head, will try copies on 0,4 2024-04-20T02:25:16.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.496+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:25:16.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:25:16.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.515+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:25:16.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.542+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:25:16.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:2024-04-20T02:25:16.558031+0000 min lat: 0.000210708 max lat: 0.343331 avg lat: 0.0011024 2024-04-20T02:25:16.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-20T02:25:16.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 340 15 4871267 4871252 895.35 910.688 0.000760876 0.0011024 2024-04-20T02:25:16.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.558+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:25:16.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.563+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:25:16.575 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.576+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:25:16.577 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.578+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:25:16.604 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.604+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:25:16.616 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.617+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0ff7d29:::benchmark_data_smithi171_44355_object2897:head, will try copies on 2,4 2024-04-20T02:25:16.617 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.618+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:25:16.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.642+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:25:16.654 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.654+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:25:16.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:25:16.676 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.676+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad8f28a3:::benchmark_data_smithi171_44355_object3987:head, will try copies on 0,4 2024-04-20T02:25:16.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.692+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf70107:::benchmark_data_smithi171_44355_object3531:head, will try copies on 0,4 2024-04-20T02:25:16.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.707+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:25:16.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.710+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:25:16.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.745+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:16.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.764+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb9daee:::benchmark_data_smithi171_44355_object4264:head, will try copies on 0,4 2024-04-20T02:25:16.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.770+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:25:16.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.773+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aab67d82:::benchmark_data_smithi171_44355_object1358:head, will try copies on 0,4 2024-04-20T02:25:16.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.796+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:25:16.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.835+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:25:16.854 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.855+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:25:16.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.875+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad0af9df:::benchmark_data_smithi171_44355_object981:head, will try copies on 0,4 2024-04-20T02:25:16.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.968+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:25:16.989 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:16.989+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:25:17.017 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.018+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:25:17.020 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.021+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:25:17.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.041+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:25:17.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.048+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd623bf2:::benchmark_data_smithi171_44355_object1401:head, will try copies on 2,4 2024-04-20T02:25:17.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.074+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:25:17.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.085+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:25:17.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.102+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:25:17.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.116+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:25:17.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.152+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:25:17.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.174+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:25:17.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.201+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6f6b99:::benchmark_data_smithi171_44355_object2474:head, will try copies on 0,4 2024-04-20T02:25:17.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.214+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:25:17.230 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.231+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:25:17.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.232+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:25:17.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.276+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:25:17.281 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.282+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8c11bb2:::benchmark_data_smithi171_44355_object537:head, will try copies on 0,4 2024-04-20T02:25:17.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.302+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:17.302 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.302+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:25:17.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.324+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:25:17.324 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.325+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:25:17.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.342+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e513a35f:::benchmark_data_smithi171_44355_object2350:head, will try copies on 0,4 2024-04-20T02:25:17.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.376+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:25:17.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.386+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:25:17.386 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.387+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:25:17.398 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.399+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:25:17.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:25:17.412 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.413+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:25:17.437 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.438+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:17.450 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.450+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aac53a80:::benchmark_data_smithi171_44355_object3570:head, will try copies on 0,4 2024-04-20T02:25:17.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.475+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aee546da:::benchmark_data_smithi171_44355_object422:head, will try copies on 0,4 2024-04-20T02:25:17.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.480+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:25:17.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.498+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:25:17.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.524+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:25:17.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.532+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:25:17.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.551+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2749a93:::benchmark_data_smithi171_44355_object4308:head, will try copies on 0,4 2024-04-20T02:25:17.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 341 16 4884636 4884620 895.174 835.5 0.000643641 0.00110262 2024-04-20T02:25:17.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.568+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:25:17.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.571+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:25:17.601 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.601+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:17.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.607+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:25:17.627 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.627+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:25:17.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.651+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8bfca39:::benchmark_data_smithi171_44355_object3564:head, will try copies on 0,4 2024-04-20T02:25:17.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.671+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:25:17.711 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.711+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce94ee:::benchmark_data_smithi171_44355_object3277:head, will try copies on 2,4 2024-04-20T02:25:17.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.719+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:25:17.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.751+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:25:17.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.753+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:25:17.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.766+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4835a74:::benchmark_data_smithi171_44355_object1252:head, will try copies on 0,4 2024-04-20T02:25:17.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.791+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:25:17.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.797+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:25:17.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.804+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:25:17.815 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.816+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:25:17.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.850+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a59e270d:::benchmark_data_smithi171_44355_object3210:head, will try copies on 0,4 2024-04-20T02:25:17.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.900+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8f6838e:::benchmark_data_smithi171_44355_object3424:head, will try copies on 0,4 2024-04-20T02:25:17.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.924+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:25:17.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.931+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:25:17.933 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.934+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:25:17.947 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.947+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a93b551a:::benchmark_data_smithi171_44355_object2691:head, will try copies on 0,4 2024-04-20T02:25:17.960 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.961+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:25:17.964 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.965+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a526b50d:::benchmark_data_smithi171_44355_object2715:head, will try copies on 0,4 2024-04-20T02:25:17.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.976+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:25:17.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:17.991+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:25:18.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.012+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1830289:::benchmark_data_smithi171_44355_object2268:head, will try copies on 0,4 2024-04-20T02:25:18.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.029+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:25:18.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.080+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7a3e0f9:::benchmark_data_smithi171_44355_object3468:head, will try copies on 0,4 2024-04-20T02:25:18.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.099+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:25:18.099 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.100+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:25:18.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.160+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:25:18.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.164+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:25:18.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.174+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:25:18.180 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.180+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:25:18.186 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa581e7c:::benchmark_data_smithi171_44355_object3113:head, will try copies on 0,4 2024-04-20T02:25:18.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.217+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e827ed66:::benchmark_data_smithi171_44355_object3543:head, will try copies on 0,4 2024-04-20T02:25:18.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.246+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:25:18.275 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.275+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:25:18.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.294+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:25:18.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.331+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5a99462:::benchmark_data_smithi171_44355_object2233:head, will try copies on 0,4 2024-04-20T02:25:18.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.332+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:25:18.344 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.345+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48f86e:::benchmark_data_smithi171_44355_object4357:head, will try copies on 2,4 2024-04-20T02:25:18.347 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.348+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a017f16e:::benchmark_data_smithi171_44355_object4090:head, will try copies on 0,4 2024-04-20T02:25:18.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.364+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3f323:::benchmark_data_smithi171_44355_object4302:head, will try copies on 2,4 2024-04-20T02:25:18.387 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.388+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1aa3237:::benchmark_data_smithi171_44355_object3648:head, will try copies on 0,4 2024-04-20T02:25:18.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.390+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:18.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.429+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:25:18.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.467+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:25:18.471 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.471+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:25:18.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.500+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:25:18.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.507+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef1dbf29:::benchmark_data_smithi171_44355_object1372:head, will try copies on 0,4 2024-04-20T02:25:18.540 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.540+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee3fac6c:::benchmark_data_smithi171_44355_object3188:head, will try copies on 0,4 2024-04-20T02:25:18.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.545+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:25:18.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 342 16 4898572 4898556 895.103 871 0.000677921 0.00110271 2024-04-20T02:25:18.576 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.577+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed88fc9:::benchmark_data_smithi171_44355_object2825:head, will try copies on 0,4 2024-04-20T02:25:18.588 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.588+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:25:18.595 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.595+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:25:18.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.609+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:25:18.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.609+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:25:18.635 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.635+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:25:18.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.685+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:25:18.696 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.696+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:25:18.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78d5277:::benchmark_data_smithi171_44355_object3921:head, will try copies on 0,4 2024-04-20T02:25:18.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.730+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:25:18.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.746+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:25:18.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.747+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:25:18.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.782+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:25:18.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.795+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:25:18.832 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.832+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:25:18.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.837+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:25:18.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.864+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49328a5:::benchmark_data_smithi171_44355_object2964:head, will try copies on 2,4 2024-04-20T02:25:18.864 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.864+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad6060d1:::benchmark_data_smithi171_44355_object1825:head, will try copies on 0,4 2024-04-20T02:25:18.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.874+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:25:18.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.886+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:25:18.917 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.916+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62a98e3:::benchmark_data_smithi171_44355_object3314:head, will try copies on 0,4 2024-04-20T02:25:18.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.936+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:18.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.955+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:18.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.957+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af35e55b:::benchmark_data_smithi171_44355_object91:head, will try copies on 0,4 2024-04-20T02:25:18.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:18.997+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:25:19.004 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.004+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19fb17a:::benchmark_data_smithi171_44355_object2620:head, will try copies on 0,4 2024-04-20T02:25:19.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.034+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:25:19.046 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.045+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:25:19.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.065+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:25:19.083 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.083+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:25:19.095 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.095+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afcfb440:::benchmark_data_smithi171_44355_object4117:head, will try copies on 0,4 2024-04-20T02:25:19.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.114+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:19.115 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.114+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce694edc:::benchmark_data_smithi171_44355_object1384:head, will try copies on 2,4 2024-04-20T02:25:19.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.122+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d6c8fa:::benchmark_data_smithi171_44355_object2556:head, will try copies on 0,4 2024-04-20T02:25:19.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.133+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:25:19.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.192+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a62cf09c:::benchmark_data_smithi171_44355_object3741:head, will try copies on 0,4 2024-04-20T02:25:19.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.213+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:25:19.216 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.216+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:25:19.236 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.235+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:25:19.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.269+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019f870:::benchmark_data_smithi171_44355_object2943:head, will try copies on 2,4 2024-04-20T02:25:19.293 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:25:19.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.301+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:25:19.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.348+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:25:19.363 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.363+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:25:19.389 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.389+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e16a3dda:::benchmark_data_smithi171_44355_object2099:head, will try copies on 0,4 2024-04-20T02:25:19.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.407+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:25:19.417 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.416+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6dfe0d2:::benchmark_data_smithi171_44355_object456:head, will try copies on 2,4 2024-04-20T02:25:19.445 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.444+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:25:19.446 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.446+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:25:19.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.454+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aecda338:::benchmark_data_smithi171_44355_object1294:head, will try copies on 0,4 2024-04-20T02:25:19.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.482+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:25:19.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:25:19.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.521+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7044e47:::benchmark_data_smithi171_44355_object3068:head, will try copies on 0,4 2024-04-20T02:25:19.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.532+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:25:19.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 343 16 4912957 4912941 895.115 899.062 0.000938865 0.0011027 2024-04-20T02:25:19.586 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.585+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba84ad8:::benchmark_data_smithi171_44355_object2390:head, will try copies on 0,4 2024-04-20T02:25:19.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:25:19.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.606+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:25:19.608 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.608+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:25:19.628 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.628+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:25:19.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.653+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab672244:::benchmark_data_smithi171_44355_object4065:head, will try copies on 0,4 2024-04-20T02:25:19.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.665+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:25:19.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.669+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8845f8d:::benchmark_data_smithi171_44355_object27:head, will try copies on 0,4 2024-04-20T02:25:19.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.686+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:25:19.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.691+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:25:19.706 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.706+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf60272f:::benchmark_data_smithi171_44355_object546:head, will try copies on 2,4 2024-04-20T02:25:19.740 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.740+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5072230:::benchmark_data_smithi171_44355_object3223:head, will try copies on 2,4 2024-04-20T02:25:19.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.746+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0bf9fad:::benchmark_data_smithi171_44355_object1619:head, will try copies on 0,4 2024-04-20T02:25:19.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.768+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:25:19.778 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.778+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:25:19.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.799+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:25:19.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.801+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:25:19.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.834+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:25:19.836 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.835+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae872fa6:::benchmark_data_smithi171_44355_object2738:head, will try copies on 0,4 2024-04-20T02:25:19.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.850+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:25:19.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.869+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:25:19.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.887+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:25:19.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.910+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec8fe651:::benchmark_data_smithi171_44355_object4058:head, will try copies on 0,4 2024-04-20T02:25:19.942 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.941+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:25:19.967 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.966+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:25:19.991 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:19.990+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:25:20.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.000+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:25:20.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.007+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:25:20.029 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.028+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:25:20.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.033+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:25:20.110 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.110+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:25:20.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.113+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:20.143 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.142+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:25:20.168 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.168+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:25:20.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.182+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:25:20.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.184+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:20.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.194+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:25:20.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.233+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:25:20.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:20.251 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.250+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:25:20.260 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.259+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a95709c7:::benchmark_data_smithi171_44355_object1203:head, will try copies on 0,4 2024-04-20T02:25:20.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.279+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:25:20.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.289+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:25:20.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.298+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:25:20.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.307+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:25:20.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.336+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c36cc97b:::benchmark_data_smithi171_44355_object1075:head, will try copies on 2,4 2024-04-20T02:25:20.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.380+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:20.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.380+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:25:20.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.418+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:25:20.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.462+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cade65c6:::benchmark_data_smithi171_44355_object3457:head, will try copies on 2,4 2024-04-20T02:25:20.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.466+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3fbb505:::benchmark_data_smithi171_44355_object1254:head, will try copies on 0,4 2024-04-20T02:25:20.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.466+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:25:20.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.496+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:25:20.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.498+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:25:20.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.503+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:25:20.531 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.529+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:25:20.549 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.548+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a77d8677:::benchmark_data_smithi171_44355_object3154:head, will try copies on 0,4 2024-04-20T02:25:20.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 344 16 4927267 4927251 895.112 894.375 0.00153497 0.0011027 2024-04-20T02:25:20.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.563+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1e3c4e8:::benchmark_data_smithi171_44355_object2780:head, will try copies on 0,4 2024-04-20T02:25:20.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.581+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:25:20.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.591+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e54a5c0e:::benchmark_data_smithi171_44355_object3279:head, will try copies on 0,4 2024-04-20T02:25:20.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.594+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:25:20.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.625+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6287e51:::benchmark_data_smithi171_44355_object3854:head, will try copies on 0,4 2024-04-20T02:25:20.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.642+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78c99d0:::benchmark_data_smithi171_44355_object3273:head, will try copies on 2,4 2024-04-20T02:25:20.652 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.651+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a23a7a:::benchmark_data_smithi171_44355_object3033:head, will try copies on 0,4 2024-04-20T02:25:20.657 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.656+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:25:20.665 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.664+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:20.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.676+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:25:20.690 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.689+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:25:20.691 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.690+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:25:20.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.734+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:25:20.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.749+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec783ac9:::benchmark_data_smithi171_44355_object1782:head, will try copies on 0,4 2024-04-20T02:25:20.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.772+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:25:20.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.782+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e84f2b57:::benchmark_data_smithi171_44355_object1212:head, will try copies on 0,4 2024-04-20T02:25:20.790 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.789+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:25:20.795 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.795+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:25:20.803 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.802+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:20.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.830+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:25:20.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.859+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a851ab08:::benchmark_data_smithi171_44355_object1886:head, will try copies on 0,4 2024-04-20T02:25:20.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.869+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c80c28:::benchmark_data_smithi171_44355_object535:head, will try copies on 0,4 2024-04-20T02:25:20.874 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.872+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:25:20.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.898+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:25:20.905 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.905+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:25:20.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.906+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb682533:::benchmark_data_smithi171_44355_object2366:head, will try copies on 0,4 2024-04-20T02:25:20.936 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.936+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:25:20.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.948+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf9d30bb:::benchmark_data_smithi171_44355_object2882:head, will try copies on 2,4 2024-04-20T02:25:20.995 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:20.995+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5f6c49d:::benchmark_data_smithi171_44355_object3806:head, will try copies on 0,4 2024-04-20T02:25:21.010 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.010+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:25:21.035 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.034+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:25:21.071 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.070+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efa386a0:::benchmark_data_smithi171_44355_object2484:head, will try copies on 0,4 2024-04-20T02:25:21.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.087+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c14e7084:::benchmark_data_smithi171_44355_object46:head, will try copies on 2,4 2024-04-20T02:25:21.116 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.116+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:25:21.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.117+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:25:21.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.127+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:25:21.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.170+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:25:21.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.183+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:25:21.192 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.192+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac09c928:::benchmark_data_smithi171_44355_object2026:head, will try copies on 0,4 2024-04-20T02:25:21.205 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.205+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:25:21.218 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.218+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:25:21.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.228+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99cbfa4:::benchmark_data_smithi171_44355_object3712:head, will try copies on 2,4 2024-04-20T02:25:21.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.254+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:25:21.261 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.261+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:25:21.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.266+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:25:21.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.293+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:25:21.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.319+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:25:21.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.331+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:25:21.337 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.337+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eba455bd:::benchmark_data_smithi171_44355_object3812:head, will try copies on 0,4 2024-04-20T02:25:21.349 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.348+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:25:21.353 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.353+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada434bf:::benchmark_data_smithi171_44355_object363:head, will try copies on 0,4 2024-04-20T02:25:21.375 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.374+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:25:21.381 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.380+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee09fd7f:::benchmark_data_smithi171_44355_object4242:head, will try copies on 0,4 2024-04-20T02:25:21.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.411+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f3c49c:::benchmark_data_smithi171_44355_object2630:head, will try copies on 0,4 2024-04-20T02:25:21.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.420+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:25:21.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.473+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:25:21.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.483+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:25:21.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.495+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:25:21.507 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.507+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad8fd8c:::benchmark_data_smithi171_44355_object3393:head, will try copies on 2,4 2024-04-20T02:25:21.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.537+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:25:21.555 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.554+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:25:21.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 345 16 4941582 4941566 895.111 894.688 0.000547032 0.0011027 2024-04-20T02:25:21.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.561+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:25:21.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.573+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:25:21.603 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.602+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:25:21.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:25:21.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.641+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:25:21.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.647+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6475c0c:::benchmark_data_smithi171_44355_object1979:head, will try copies on 0,4 2024-04-20T02:25:21.658 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.658+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e58d4a6d:::benchmark_data_smithi171_44355_object2958:head, will try copies on 0,4 2024-04-20T02:25:21.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.703+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:25:21.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.723+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5bf10e2:::benchmark_data_smithi171_44355_object1455:head, will try copies on 0,4 2024-04-20T02:25:21.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.753+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e37334e9:::benchmark_data_smithi171_44355_object3787:head, will try copies on 0,4 2024-04-20T02:25:21.779 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.779+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:25:21.820 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.820+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:25:21.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.833+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:25:21.856 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.856+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:21.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.860+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:25:21.883 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.883+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:25:21.898 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.896+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:25:21.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.900+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:25:21.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.911+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:25:21.916 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.915+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb395d8b:::benchmark_data_smithi171_44355_object2018:head, will try copies on 2,4 2024-04-20T02:25:21.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.925+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e76af4c9:::benchmark_data_smithi171_44355_object255:head, will try copies on 0,4 2024-04-20T02:25:21.931 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.930+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:25:21.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.937+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:25:21.980 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.979+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd3ec40:::benchmark_data_smithi171_44355_object4116:head, will try copies on 2,4 2024-04-20T02:25:21.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.984+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:25:21.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:21.996+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:22.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.021+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:25:22.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.040+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:25:22.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.049+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a870f049:::benchmark_data_smithi171_44355_object625:head, will try copies on 0,4 2024-04-20T02:25:22.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.067+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9df5011:::benchmark_data_smithi171_44355_object2451:head, will try copies on 2,4 2024-04-20T02:25:22.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.083+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7270f5:::benchmark_data_smithi171_44355_object1597:head, will try copies on 2,4 2024-04-20T02:25:22.087 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.087+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb024a9f:::benchmark_data_smithi171_44355_object976:head, will try copies on 0,4 2024-04-20T02:25:22.146 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.145+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8e1ec7c:::benchmark_data_smithi171_44355_object3448:head, will try copies on 0,4 2024-04-20T02:25:22.147 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.147+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9e49a:::benchmark_data_smithi171_44355_object1336:head, will try copies on 0,4 2024-04-20T02:25:22.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.160+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4fe44e2:::benchmark_data_smithi171_44355_object2344:head, will try copies on 2,4 2024-04-20T02:25:22.176 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.176+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:25:22.184 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.183+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:25:22.210 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.210+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4340b2:::benchmark_data_smithi171_44355_object2900:head, will try copies on 0,4 2024-04-20T02:25:22.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.214+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:25:22.233 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.233+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:22.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.245+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e77d692b:::benchmark_data_smithi171_44355_object2019:head, will try copies on 0,4 2024-04-20T02:25:22.292 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.292+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:25:22.322 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.321+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:25:22.341 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.341+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:25:22.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.341+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:25:22.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.350+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:25:22.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.376+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a66a7d75:::benchmark_data_smithi171_44355_object4167:head, will try copies on 0,4 2024-04-20T02:25:22.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.380+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07e4102:::benchmark_data_smithi171_44355_object2786:head, will try copies on 2,4 2024-04-20T02:25:22.406 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.405+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21bad94:::benchmark_data_smithi171_44355_object2991:head, will try copies on 0,4 2024-04-20T02:25:22.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.418+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:25:22.428 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.428+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:25:22.438 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.437+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:25:22.455 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.454+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:25:22.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.455+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa0741e3:::benchmark_data_smithi171_44355_object2492:head, will try copies on 0,4 2024-04-20T02:25:22.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.466+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb722400:::benchmark_data_smithi171_44355_object1329:head, will try copies on 2,4 2024-04-20T02:25:22.483 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.483+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:25:22.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.491+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c97a5538:::benchmark_data_smithi171_44355_object3939:head, will try copies on 2,4 2024-04-20T02:25:22.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.497+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:25:22.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.515+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:25:22.522 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.521+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:25:22.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.532+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6a12d21:::benchmark_data_smithi171_44355_object4145:head, will try copies on 0,4 2024-04-20T02:25:22.550 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.549+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:25:22.553 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.553+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4e1db46:::benchmark_data_smithi171_44355_object326:head, will try copies on 2,4 2024-04-20T02:25:22.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 346 16 4955507 4955491 895.039 870.312 0.000679538 0.00110279 2024-04-20T02:25:22.561 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.560+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:25:22.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.591+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:25:22.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.605+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a45a8563:::benchmark_data_smithi171_44355_object125:head, will try copies on 0,4 2024-04-20T02:25:22.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.609+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:25:22.630 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.630+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:25:22.636 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.636+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eaf70a39:::benchmark_data_smithi171_44355_object3099:head, will try copies on 0,4 2024-04-20T02:25:22.659 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.659+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:25:22.682 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.682+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b57f2d:::benchmark_data_smithi171_44355_object871:head, will try copies on 0,4 2024-04-20T02:25:22.686 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.686+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:25:22.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.699+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa8b8525:::benchmark_data_smithi171_44355_object425:head, will try copies on 0,4 2024-04-20T02:25:22.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.728+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a215613c:::benchmark_data_smithi171_44355_object3627:head, will try copies on 0,4 2024-04-20T02:25:22.738 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.738+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:25:22.750 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.749+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:25:22.782 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.782+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:25:22.810 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.810+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:25:22.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:25:22.828 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.828+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:22.859 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.858+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:25:22.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.887+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:25:22.922 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.921+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:25:22.935 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.935+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a92dc424:::benchmark_data_smithi171_44355_object3878:head, will try copies on 0,4 2024-04-20T02:25:22.937 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.936+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:25:22.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.959+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:25:22.961 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:22.960+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:25:23.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.000+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:25:23.009 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.008+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:25:23.023 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.023+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:25:23.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.039+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:25:23.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.045+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad712efb:::benchmark_data_smithi171_44355_object4221:head, will try copies on 0,4 2024-04-20T02:25:23.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.068+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:25:23.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.072+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:25:23.085 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.085+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:25:23.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.089+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:23.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.125+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:25:23.126 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.125+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:25:23.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.126+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:25:23.167 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.166+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:25:23.183 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.183+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:25:23.193 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.193+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:25:23.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.202+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab43f318:::benchmark_data_smithi171_44355_object1816:head, will try copies on 0,4 2024-04-20T02:25:23.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.222+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:25:23.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.227+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:25:23.228 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.228+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:23.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.262+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:25:23.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.299+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:25:23.319 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.319+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:25:23.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.325+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:25:23.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.335+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6404e1f:::benchmark_data_smithi171_44355_object2835:head, will try copies on 0,4 2024-04-20T02:25:23.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.351+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:25:23.369 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.368+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:25:23.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.393+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:25:23.399 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.399+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c253a0e4:::benchmark_data_smithi171_44355_object3635:head, will try copies on 2,4 2024-04-20T02:25:23.413 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.413+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe10be4:::benchmark_data_smithi171_44355_object648:head, will try copies on 0,4 2024-04-20T02:25:23.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.415+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:25:23.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.463+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:25:23.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.483+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:25:23.496 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.496+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:25:23.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.506+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:25:23.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.517+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:25:23.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.539+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebadd1de:::benchmark_data_smithi171_44355_object339:head, will try copies on 0,4 2024-04-20T02:25:23.544 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.544+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8d030bf:::benchmark_data_smithi171_44355_object501:head, will try copies on 2,4 2024-04-20T02:25:23.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 347 16 4969684 4969668 895.013 886.062 0.0011448 0.00110283 2024-04-20T02:25:23.579 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.579+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e57895c8:::benchmark_data_smithi171_44355_object3870:head, will try copies on 0,4 2024-04-20T02:25:23.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.580+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:25:23.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2e57758:::benchmark_data_smithi171_44355_object4245:head, will try copies on 0,4 2024-04-20T02:25:23.609 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.608+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:25:23.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.649+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:25:23.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.665+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff573c0:::benchmark_data_smithi171_44355_object452:head, will try copies on 2,4 2024-04-20T02:25:23.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.693+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:25:23.695 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.694+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:25:23.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.715+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7379a02:::benchmark_data_smithi171_44355_object3016:head, will try copies on 0,4 2024-04-20T02:25:23.729 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.729+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:25:23.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.734+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:25:23.764 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.764+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:23.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.774+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb217291:::benchmark_data_smithi171_44355_object2582:head, will try copies on 0,4 2024-04-20T02:25:23.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.814+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed31b5ee:::benchmark_data_smithi171_44355_object1563:head, will try copies on 0,4 2024-04-20T02:25:23.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.827+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af0405b5:::benchmark_data_smithi171_44355_object3532:head, will try copies on 0,4 2024-04-20T02:25:23.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.839+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:25:23.844 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.844+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:25:23.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.849+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce351c2:::benchmark_data_smithi171_44355_object1387:head, will try copies on 2,4 2024-04-20T02:25:23.882 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.882+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:25:23.894 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.894+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:25:23.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.912+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:25:23.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:23.929+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:25:24.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.014+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e96795d3:::benchmark_data_smithi171_44355_object4340:head, will try copies on 0,4 2024-04-20T02:25:24.030 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.030+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:25:24.033 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.033+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:25:24.055 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.055+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:25:24.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.094+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:25:24.104 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.103+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab52ba24:::benchmark_data_smithi171_44355_object4034:head, will try copies on 0,4 2024-04-20T02:25:24.119 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.119+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:25:24.155 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.154+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8494401:::benchmark_data_smithi171_44355_object1174:head, will try copies on 0,4 2024-04-20T02:25:24.159 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.158+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3115a63:::benchmark_data_smithi171_44355_object3994:head, will try copies on 0,4 2024-04-20T02:25:24.195 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.194+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:25:24.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.225+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:25:24.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.246+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0b988fd:::benchmark_data_smithi171_44355_object4048:head, will try copies on 0,4 2024-04-20T02:25:24.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.306+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:25:24.310 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.310+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a006a8:::benchmark_data_smithi171_44355_object613:head, will try copies on 0,4 2024-04-20T02:25:24.326 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.325+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c654d3c1:::benchmark_data_smithi171_44355_object3796:head, will try copies on 2,4 2024-04-20T02:25:24.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.351+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a97eb861:::benchmark_data_smithi171_44355_object1533:head, will try copies on 0,4 2024-04-20T02:25:24.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.372+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc239615:::benchmark_data_smithi171_44355_object2070:head, will try copies on 2,4 2024-04-20T02:25:24.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.392+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:25:24.449 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.448+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e12cc928:::benchmark_data_smithi171_44355_object446:head, will try copies on 0,4 2024-04-20T02:25:24.467 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.467+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:25:24.470 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.470+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efeaa01b:::benchmark_data_smithi171_44355_object3351:head, will try copies on 0,4 2024-04-20T02:25:24.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.479+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:25:24.497 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.497+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb57fd05:::benchmark_data_smithi171_44355_object2068:head, will try copies on 2,4 2024-04-20T02:25:24.503 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.503+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:25:24.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.532+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd878338:::benchmark_data_smithi171_44355_object2537:head, will try copies on 2,4 2024-04-20T02:25:24.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.539+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:25:24.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 348 16 4984200 4984184 895.048 907.25 0.00102773 0.00110278 2024-04-20T02:25:24.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.566+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed397a29:::benchmark_data_smithi171_44355_object2894:head, will try copies on 0,4 2024-04-20T02:25:24.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.568+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:25:24.573 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.573+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:25:24.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.593+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:25:24.622 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.621+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd66ed3:::benchmark_data_smithi171_44355_object3816:head, will try copies on 0,4 2024-04-20T02:25:24.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.650+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6af189c:::benchmark_data_smithi171_44355_object2632:head, will try copies on 2,4 2024-04-20T02:25:24.660 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.660+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab78a901:::benchmark_data_smithi171_44355_object2273:head, will try copies on 0,4 2024-04-20T02:25:24.685 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.684+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3aa43be:::benchmark_data_smithi171_44355_object4056:head, will try copies on 0,4 2024-04-20T02:25:24.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.703+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:25:24.707 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.707+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8a0d46e:::benchmark_data_smithi171_44355_object634:head, will try copies on 0,4 2024-04-20T02:25:24.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.722+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb135ee4:::benchmark_data_smithi171_44355_object2324:head, will try copies on 0,4 2024-04-20T02:25:24.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.764+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3c6299:::benchmark_data_smithi171_44355_object376:head, will try copies on 0,4 2024-04-20T02:25:24.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.784+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ada04dfe:::benchmark_data_smithi171_44355_object1552:head, will try copies on 0,4 2024-04-20T02:25:24.800 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.800+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:25:24.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.850+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:24.910 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.910+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1dfd2c:::benchmark_data_smithi171_44355_object2559:head, will try copies on 0,4 2024-04-20T02:25:24.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.926+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:25:24.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.926+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:25:24.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.973+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:25:24.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.993+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5de46ce:::benchmark_data_smithi171_44355_object2182:head, will try copies on 0,4 2024-04-20T02:25:24.994 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:24.994+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:25:25.014 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.013+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:25:25.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.159+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:25.170 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.170+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:25:25.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.184+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e512103f:::benchmark_data_smithi171_44355_object2307:head, will try copies on 0,4 2024-04-20T02:25:25.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2553c24:::benchmark_data_smithi171_44355_object4037:head, will try copies on 0,4 2024-04-20T02:25:25.197 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.196+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:25:25.201 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.201+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1053200:::benchmark_data_smithi171_44355_object8:head, will try copies on 0,4 2024-04-20T02:25:25.225 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.224+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:25:25.245 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.245+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:25:25.256 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.255+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ceb62b60:::benchmark_data_smithi171_44355_object3446:head, will try copies on 2,4 2024-04-20T02:25:25.263 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.263+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:25:25.267 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.266+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:25:25.299 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.298+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3d17bd5:::benchmark_data_smithi171_44355_object3798:head, will try copies on 2,4 2024-04-20T02:25:25.328 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.327+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9020d6c:::benchmark_data_smithi171_44355_object3143:head, will try copies on 0,4 2024-04-20T02:25:25.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.333+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:25:25.392 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.391+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdd50827:::benchmark_data_smithi171_44355_object1718:head, will try copies on 2,4 2024-04-20T02:25:25.419 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.419+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:25:25.461 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.460+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:25:25.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.481+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c019449f:::benchmark_data_smithi171_44355_object2423:head, will try copies on 2,4 2024-04-20T02:25:25.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.482+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d23913:::benchmark_data_smithi171_44355_object3305:head, will try copies on 0,4 2024-04-20T02:25:25.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.508+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22490ac:::benchmark_data_smithi171_44355_object3354:head, will try copies on 0,4 2024-04-20T02:25:25.509 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.509+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:25:25.538 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.537+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:25:25.539 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.538+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fce916:::benchmark_data_smithi171_44355_object4365:head, will try copies on 2,4 2024-04-20T02:25:25.545 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.545+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e93cb9bb:::benchmark_data_smithi171_44355_object2505:head, will try copies on 0,4 2024-04-20T02:25:25.557 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 349 16 4997323 4997307 894.833 820.188 0.00090926 0.00110304 2024-04-20T02:25:25.570 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.570+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4db07a3:::benchmark_data_smithi171_44355_object66:head, will try copies on 0,4 2024-04-20T02:25:25.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.591+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6abb2eb:::benchmark_data_smithi171_44355_object2217:head, will try copies on 0,4 2024-04-20T02:25:25.599 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.599+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:25:25.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.606+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:25:25.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.630+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:25:25.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.631+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b7f21e:::benchmark_data_smithi171_44355_object3073:head, will try copies on 0,4 2024-04-20T02:25:25.650 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.650+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7371bc2:::benchmark_data_smithi171_44355_object300:head, will try copies on 2,4 2024-04-20T02:25:25.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.663+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab8c6040:::benchmark_data_smithi171_44355_object1473:head, will try copies on 0,4 2024-04-20T02:25:25.673 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.672+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:25:25.678 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.678+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1aa6f21:::benchmark_data_smithi171_44355_object4148:head, will try copies on 2,4 2024-04-20T02:25:25.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.726+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:25:25.744 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.744+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a6c6ad38:::benchmark_data_smithi171_44355_object1299:head, will try copies on 0,4 2024-04-20T02:25:25.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.798+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:25:25.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.801+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:25:25.842 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.842+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8e1e3d5:::benchmark_data_smithi171_44355_object1:head, will try copies on 2,4 2024-04-20T02:25:25.863 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.863+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef6cdf36:::benchmark_data_smithi171_44355_object550:head, will try copies on 0,4 2024-04-20T02:25:25.913 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.913+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efb38e74:::benchmark_data_smithi171_44355_object2762:head, will try copies on 0,4 2024-04-20T02:25:25.928 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.927+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a24150a5:::benchmark_data_smithi171_44355_object232:head, will try copies on 0,4 2024-04-20T02:25:25.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.975+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:25:25.985 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.985+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:25:25.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:25.997+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:25:26.012 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.012+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c026bd41:::benchmark_data_smithi171_44355_object2154:head, will try copies on 2,4 2024-04-20T02:25:26.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.028+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa98f46f:::benchmark_data_smithi171_44355_object176:head, will try copies on 0,4 2024-04-20T02:25:26.049 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.049+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:25:26.067 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.066+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:25:26.068 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.068+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e4365c:::benchmark_data_smithi171_44355_object2241:head, will try copies on 0,4 2024-04-20T02:25:26.073 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.073+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:25:26.123 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.123+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:25:26.152 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.152+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a89701e2:::benchmark_data_smithi171_44355_object2794:head, will try copies on 0,4 2024-04-20T02:25:26.161 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.160+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:25:26.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.221+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:25:26.246 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.245+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:25:26.248 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.248+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:25:26.271 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.270+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef3192c8:::benchmark_data_smithi171_44355_object2044:head, will try copies on 0,4 2024-04-20T02:25:26.305 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.304+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e85b790c:::benchmark_data_smithi171_44355_object1990:head, will try copies on 0,4 2024-04-20T02:25:26.317 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.317+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce8aee4:::benchmark_data_smithi171_44355_object3892:head, will try copies on 2,4 2024-04-20T02:25:26.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.330+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a32d7b64:::benchmark_data_smithi171_44355_object20:head, will try copies on 0,4 2024-04-20T02:25:26.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.336+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:26.354 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.353+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:25:26.355 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.355+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:25:26.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.373+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:25:26.402 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.401+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4912696:::benchmark_data_smithi171_44355_object1965:head, will try copies on 0,4 2024-04-20T02:25:26.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.444+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:25:26.460 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.460+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:25:26.511 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.510+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae12ab5a:::benchmark_data_smithi171_44355_object6:head, will try copies on 0,4 2024-04-20T02:25:26.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.515+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:26.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.534+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa65e855:::benchmark_data_smithi171_44355_object3677:head, will try copies on 0,4 2024-04-20T02:25:26.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 350 16 5011828 5011812 894.866 906.562 0.000773329 0.00110301 2024-04-20T02:25:26.560 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.560+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:25:26.580 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.580+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:25:26.612 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.612+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa4f0bc1:::benchmark_data_smithi171_44355_object3797:head, will try copies on 0,4 2024-04-20T02:25:26.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.613+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c99d151e:::benchmark_data_smithi171_44355_object3964:head, will try copies on 2,4 2024-04-20T02:25:26.640 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.640+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af13a5f9:::benchmark_data_smithi171_44355_object3707:head, will try copies on 0,4 2024-04-20T02:25:26.651 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.651+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c38c15f3:::benchmark_data_smithi171_44355_object4255:head, will try copies on 2,4 2024-04-20T02:25:26.689 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.688+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:26.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e2d837:::benchmark_data_smithi171_44355_object4270:head, will try copies on 0,4 2024-04-20T02:25:26.722 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.722+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:25:26.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.728+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:25:26.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.745+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:25:26.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.758+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee2946cf:::benchmark_data_smithi171_44355_object3460:head, will try copies on 0,4 2024-04-20T02:25:26.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.765+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd7ea0de:::benchmark_data_smithi171_44355_object3071:head, will try copies on 2,4 2024-04-20T02:25:26.773 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.773+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8139493:::benchmark_data_smithi171_44355_object3501:head, will try copies on 0,4 2024-04-20T02:25:26.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.790+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec1a5b6f:::benchmark_data_smithi171_44355_object2696:head, will try copies on 0,4 2024-04-20T02:25:26.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.808+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a78f1895:::benchmark_data_smithi171_44355_object909:head, will try copies on 0,4 2024-04-20T02:25:26.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:25:26.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.823+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee0a34e6:::benchmark_data_smithi171_44355_object1188:head, will try copies on 0,4 2024-04-20T02:25:26.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.847+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccdb9a14:::benchmark_data_smithi171_44355_object1938:head, will try copies on 2,4 2024-04-20T02:25:26.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.849+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21b5a9a:::benchmark_data_smithi171_44355_object2873:head, will try copies on 0,4 2024-04-20T02:25:26.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.878+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:26.906 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.905+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:25:26.930 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.929+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:25:26.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:25:26.958 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.958+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6f2ccd5:::benchmark_data_smithi171_44355_object951:head, will try copies on 2,4 2024-04-20T02:25:26.982 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.982+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:25:26.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:26.985+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:25:27.005 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.005+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7e9bfc4:::benchmark_data_smithi171_44355_object717:head, will try copies on 0,4 2024-04-20T02:25:27.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.034+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea7c2581:::benchmark_data_smithi171_44355_object90:head, will try copies on 0,4 2024-04-20T02:25:27.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.059+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:25:27.084 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.084+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:25:27.096 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.096+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0b140eb:::benchmark_data_smithi171_44355_object2759:head, will try copies on 0,4 2024-04-20T02:25:27.102 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.102+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:25:27.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.113+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aea36050:::benchmark_data_smithi171_44355_object1698:head, will try copies on 0,4 2024-04-20T02:25:27.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.117+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:25:27.131 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.131+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:25:27.177 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.177+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1a308ca:::benchmark_data_smithi171_44355_object3500:head, will try copies on 0,4 2024-04-20T02:25:27.182 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.182+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:25:27.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.197+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a19ea69c:::benchmark_data_smithi171_44355_object3196:head, will try copies on 0,4 2024-04-20T02:25:27.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.206+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e567f0:::benchmark_data_smithi171_44355_object3659:head, will try copies on 0,4 2024-04-20T02:25:27.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.212+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a21fe915:::benchmark_data_smithi171_44355_object3916:head, will try copies on 0,4 2024-04-20T02:25:27.229 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.228+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebc6a2df:::benchmark_data_smithi171_44355_object1179:head, will try copies on 0,4 2024-04-20T02:25:27.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.246+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:25:27.272 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.271+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7a52764:::benchmark_data_smithi171_44355_object4140:head, will try copies on 0,4 2024-04-20T02:25:27.273 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.273+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9247afd:::benchmark_data_smithi171_44355_object212:head, will try copies on 2,4 2024-04-20T02:25:27.332 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.332+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae9a50b8:::benchmark_data_smithi171_44355_object3685:head, will try copies on 0,4 2024-04-20T02:25:27.335 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.334+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:25:27.362 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.362+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:25:27.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.383+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:25:27.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:25:27.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.410+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce33f72:::benchmark_data_smithi171_44355_object3447:head, will try copies on 2,4 2024-04-20T02:25:27.468 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.468+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c783e13f:::benchmark_data_smithi171_44355_object252:head, will try copies on 2,4 2024-04-20T02:25:27.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.475+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6da79ac:::benchmark_data_smithi171_44355_object2852:head, will try copies on 0,4 2024-04-20T02:25:27.482 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.482+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:25:27.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b1a274:::benchmark_data_smithi171_44355_object1250:head, will try copies on 2,4 2024-04-20T02:25:27.513 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.512+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec4780ae:::benchmark_data_smithi171_44355_object2379:head, will try copies on 0,4 2024-04-20T02:25:27.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.514+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a575d7de:::benchmark_data_smithi171_44355_object2436:head, will try copies on 0,4 2024-04-20T02:25:27.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.557+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a96939cf:::benchmark_data_smithi171_44355_object2433:head, will try copies on 0,4 2024-04-20T02:25:27.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 351 16 5026079 5026063 894.853 890.688 0.000610085 0.00110303 2024-04-20T02:25:27.559 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.559+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1a3756b:::benchmark_data_smithi171_44355_object1326:head, will try copies on 0,4 2024-04-20T02:25:27.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.583+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf5b84c:::benchmark_data_smithi171_44355_object330:head, will try copies on 0,4 2024-04-20T02:25:27.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.594+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:25:27.634 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.634+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:25:27.666 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.665+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:25:27.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.701+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a246949d:::benchmark_data_smithi171_44355_object2297:head, will try copies on 0,4 2024-04-20T02:25:27.704 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.704+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e779eb64:::benchmark_data_smithi171_44355_object4104:head, will try copies on 0,4 2024-04-20T02:25:27.710 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.710+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c954177d:::benchmark_data_smithi171_44355_object3926:head, will try copies on 2,4 2024-04-20T02:25:27.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.759+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3f9a1e6:::benchmark_data_smithi171_44355_object210:head, will try copies on 0,4 2024-04-20T02:25:27.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.765+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e78be89b:::benchmark_data_smithi171_44355_object2669:head, will try copies on 0,4 2024-04-20T02:25:27.785 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.784+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:25:27.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.788+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac2a3c81:::benchmark_data_smithi171_44355_object1866:head, will try copies on 0,4 2024-04-20T02:25:27.798 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.798+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0820bd2:::benchmark_data_smithi171_44355_object3962:head, will try copies on 2,4 2024-04-20T02:25:27.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.809+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef626a6c:::benchmark_data_smithi171_44355_object565:head, will try copies on 0,4 2024-04-20T02:25:27.827 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.827+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:25:27.843 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.842+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132d6f5:::benchmark_data_smithi171_44355_object2529:head, will try copies on 0,4 2024-04-20T02:25:27.862 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.861+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:25:27.868 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.868+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c195be8d:::benchmark_data_smithi171_44355_object2457:head, will try copies on 2,4 2024-04-20T02:25:27.887 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.887+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3af68ca:::benchmark_data_smithi171_44355_object249:head, will try copies on 2,4 2024-04-20T02:25:27.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.899+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a376deea:::benchmark_data_smithi171_44355_object745:head, will try copies on 0,4 2024-04-20T02:25:27.915 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.915+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3dce0a5:::benchmark_data_smithi171_44355_object4055:head, will try copies on 0,4 2024-04-20T02:25:27.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.946+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eeac1d3c:::benchmark_data_smithi171_44355_object1367:head, will try copies on 0,4 2024-04-20T02:25:27.948 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.948+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd8b9f6f:::benchmark_data_smithi171_44355_object2837:head, will try copies on 2,4 2024-04-20T02:25:27.978 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.978+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afe21478:::benchmark_data_smithi171_44355_object3336:head, will try copies on 0,4 2024-04-20T02:25:27.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afa0a195:::benchmark_data_smithi171_44355_object301:head, will try copies on 0,4 2024-04-20T02:25:28.000 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:27.999+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0bd73be:::benchmark_data_smithi171_44355_object4054:head, will try copies on 0,4 2024-04-20T02:25:28.022 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.021+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbbf3eca:::benchmark_data_smithi171_44355_object864:head, will try copies on 2,4 2024-04-20T02:25:28.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.126+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4bf8692:::benchmark_data_smithi171_44355_object980:head, will try copies on 0,4 2024-04-20T02:25:28.160 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.159+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ccc67715:::benchmark_data_smithi171_44355_object889:head, will try copies on 2,4 2024-04-20T02:25:28.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.174+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb5587c4:::benchmark_data_smithi171_44355_object1528:head, will try copies on 0,4 2024-04-20T02:25:28.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.196+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:25:28.200 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.199+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63ec812:::benchmark_data_smithi171_44355_object1834:head, will try copies on 2,4 2024-04-20T02:25:28.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.211+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:25:28.226 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.225+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:25:28.243 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.243+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:25:28.250 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.248+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:25:28.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.263+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a108f87a:::benchmark_data_smithi171_44355_object2161:head, will try copies on 0,4 2024-04-20T02:25:28.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.267+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:25:28.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.279+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43ae9a1:::benchmark_data_smithi171_44355_object1335:head, will try copies on 0,4 2024-04-20T02:25:28.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.287+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a15425df:::benchmark_data_smithi171_44355_object4243:head, will try copies on 0,4 2024-04-20T02:25:28.303 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.303+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:25:28.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.324+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:25:28.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.349+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce3cc056:::benchmark_data_smithi171_44355_object654:head, will try copies on 2,4 2024-04-20T02:25:28.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.352+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3d006ef:::benchmark_data_smithi171_44355_object1734:head, will try copies on 0,4 2024-04-20T02:25:28.379 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.378+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a125af8d:::benchmark_data_smithi171_44355_object1588:head, will try copies on 0,4 2024-04-20T02:25:28.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.396+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acf19c01:::benchmark_data_smithi171_44355_object4161:head, will try copies on 0,4 2024-04-20T02:25:28.407 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.407+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:25:28.429 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.429+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:25:28.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.471+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:25:28.472 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.471+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:25:28.492 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.491+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:25:28.506 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.505+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:25:28.516 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.515+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:25:28.558 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 352 15 5039519 5039504 894.697 840.062 0.00079994 0.00110322 2024-04-20T02:25:28.569 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.569+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:25:28.623 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.622+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:25:28.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.645+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cea45eb0:::benchmark_data_smithi171_44355_object2452:head, will try copies on 2,4 2024-04-20T02:25:28.653 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.653+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec73f348:::benchmark_data_smithi171_44355_object3363:head, will try copies on 0,4 2024-04-20T02:25:28.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.669+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:25:28.709 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.709+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:25:28.727 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.727+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1a8e1ed:::benchmark_data_smithi171_44355_object3788:head, will try copies on 2,4 2024-04-20T02:25:28.734 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.734+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f5dcf:::benchmark_data_smithi171_44355_object1628:head, will try copies on 0,4 2024-04-20T02:25:28.749 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.749+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:25:28.752 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.752+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e390b455:::benchmark_data_smithi171_44355_object2972:head, will try copies on 0,4 2024-04-20T02:25:28.762 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.762+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:25:28.766 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.766+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af2a91:::benchmark_data_smithi171_44355_object2580:head, will try copies on 0,4 2024-04-20T02:25:28.789 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.788+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1c2e530:::benchmark_data_smithi171_44355_object1716:head, will try copies on 2,4 2024-04-20T02:25:28.814 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.813+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad18391f:::benchmark_data_smithi171_44355_object1830:head, will try copies on 0,4 2024-04-20T02:25:28.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.832+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:25:28.833 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.833+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ba76d7:::benchmark_data_smithi171_44355_object2966:head, will try copies on 0,4 2024-04-20T02:25:28.849 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.849+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7952af:::benchmark_data_smithi171_44355_object2979:head, will try copies on 2,4 2024-04-20T02:25:28.873 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.873+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed7eb7b1:::benchmark_data_smithi171_44355_object3700:head, will try copies on 0,4 2024-04-20T02:25:28.886 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.886+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0c0cc07:::benchmark_data_smithi171_44355_object1580:head, will try copies on 0,4 2024-04-20T02:25:28.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.967+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7b153f4:::benchmark_data_smithi171_44355_object2613:head, will try copies on 0,4 2024-04-20T02:25:28.976 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:28.976+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac286314:::benchmark_data_smithi171_44355_object1640:head, will try copies on 0,4 2024-04-20T02:25:29.036 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.035+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca2587d1:::benchmark_data_smithi171_44355_object1602:head, will try copies on 2,4 2024-04-20T02:25:29.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.064+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc141c41:::benchmark_data_smithi171_44355_object3253:head, will try copies on 2,4 2024-04-20T02:25:29.081 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.081+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a238f20f:::benchmark_data_smithi171_44355_object1779:head, will try copies on 0,4 2024-04-20T02:25:29.109 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.109+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:25:29.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.113+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0925334:::benchmark_data_smithi171_44355_object2677:head, will try copies on 0,4 2024-04-20T02:25:29.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.151+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c8cc6f:::benchmark_data_smithi171_44355_object657:head, will try copies on 0,4 2024-04-20T02:25:29.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.151+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:25:29.179 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.179+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:25:29.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.198+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8ac712c:::benchmark_data_smithi171_44355_object3762:head, will try copies on 2,4 2024-04-20T02:25:29.198 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.198+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:25:29.242 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.242+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:25:29.270 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.267+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce7043aa:::benchmark_data_smithi171_44355_object2096:head, will try copies on 2,4 2024-04-20T02:25:29.285 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.285+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cee165b1:::benchmark_data_smithi171_44355_object1280:head, will try copies on 2,4 2024-04-20T02:25:29.288 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.288+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:25:29.300 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.300+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb2835f9:::benchmark_data_smithi171_44355_object3706:head, will try copies on 2,4 2024-04-20T02:25:29.331 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.330+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:25:29.336 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.336+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee66dd4f:::benchmark_data_smithi171_44355_object3443:head, will try copies on 0,4 2024-04-20T02:25:29.356 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.355+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c02d0c08:::benchmark_data_smithi171_44355_object4010:head, will try copies on 2,4 2024-04-20T02:25:29.373 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.373+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:25:29.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.384+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c78040ce:::benchmark_data_smithi171_44355_object3127:head, will try copies on 2,4 2024-04-20T02:25:29.385 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.384+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac0345fb:::benchmark_data_smithi171_44355_object3708:head, will try copies on 0,4 2024-04-20T02:25:29.416 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.416+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:25:29.418 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.418+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eed8aaa1:::benchmark_data_smithi171_44355_object2370:head, will try copies on 0,4 2024-04-20T02:25:29.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.421+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac526242:::benchmark_data_smithi171_44355_object2784:head, will try copies on 0,4 2024-04-20T02:25:29.442 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.441+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:25:29.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.464+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:25:29.476 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.475+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3cac484:::benchmark_data_smithi171_44355_object1920:head, will try copies on 2,4 2024-04-20T02:25:29.478 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8820928:::benchmark_data_smithi171_44355_object1725:head, will try copies on 0,4 2024-04-20T02:25:29.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.487+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec908163:::benchmark_data_smithi171_44355_object4080:head, will try copies on 0,4 2024-04-20T02:25:29.490 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.490+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:25:29.523 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.523+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:25:29.537 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.537+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e50d24b7:::benchmark_data_smithi171_44355_object1788:head, will try copies on 0,4 2024-04-20T02:25:29.542 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.542+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:25:29.547 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.547+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e34e75c9:::benchmark_data_smithi171_44355_object2609:head, will try copies on 0,4 2024-04-20T02:25:29.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 353 16 5053983 5053967 894.723 903.938 0.00188079 0.00110319 2024-04-20T02:25:29.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.563+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:25:29.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.567+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:25:29.590 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.590+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef87ffef:::benchmark_data_smithi171_44355_object1605:head, will try copies on 0,4 2024-04-20T02:25:29.593 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.592+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:25:29.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.599+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:29.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.602+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e716091b:::benchmark_data_smithi171_44355_object3525:head, will try copies on 0,4 2024-04-20T02:25:29.619 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.619+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0e05997:::benchmark_data_smithi171_44355_object548:head, will try copies on 2,4 2024-04-20T02:25:29.641 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.640+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:25:29.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.663+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0802f75:::benchmark_data_smithi171_44355_object2388:head, will try copies on 2,4 2024-04-20T02:25:29.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.666+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efef4427:::benchmark_data_smithi171_44355_object3552:head, will try copies on 0,4 2024-04-20T02:25:29.693 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.692+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:25:29.703 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.703+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c34f3819:::benchmark_data_smithi171_44355_object2668:head, will try copies on 2,4 2024-04-20T02:25:29.730 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.729+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf87956:::benchmark_data_smithi171_44355_object2872:head, will try copies on 0,4 2024-04-20T02:25:29.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.739+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:25:29.748 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.748+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc2e1cb:::benchmark_data_smithi171_44355_object1686:head, will try copies on 0,4 2024-04-20T02:25:29.753 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.752+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0474f2b:::benchmark_data_smithi171_44355_object1238:head, will try copies on 2,4 2024-04-20T02:25:29.776 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.776+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afbb152b:::benchmark_data_smithi171_44355_object3734:head, will try copies on 0,4 2024-04-20T02:25:29.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.800+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:25:29.802 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.802+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80e3212:::benchmark_data_smithi171_44355_object1747:head, will try copies on 2,4 2024-04-20T02:25:29.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.811+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:25:29.840 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.840+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:25:29.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.876+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a42f9aa5:::benchmark_data_smithi171_44355_object1977:head, will try copies on 0,4 2024-04-20T02:25:29.877 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.877+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c09aedd9:::benchmark_data_smithi171_44355_object1973:head, will try copies on 2,4 2024-04-20T02:25:29.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.892+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:25:29.927 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.926+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:25:29.929 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.928+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c760c005:::benchmark_data_smithi171_44355_object956:head, will try copies on 2,4 2024-04-20T02:25:29.943 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.943+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea6cbb0b:::benchmark_data_smithi171_44355_object816:head, will try copies on 0,4 2024-04-20T02:25:29.972 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.972+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9f87344:::benchmark_data_smithi171_44355_object2198:head, will try copies on 2,4 2024-04-20T02:25:29.990 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:29.989+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eae6558d:::benchmark_data_smithi171_44355_object653:head, will try copies on 0,4 2024-04-20T02:25:30.001 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.000+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a02bc8ff:::benchmark_data_smithi171_44355_object2391:head, will try copies on 0,4 2024-04-20T02:25:30.052 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.051+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:25:30.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.054+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c35ebb84:::benchmark_data_smithi171_44355_object1514:head, will try copies on 2,4 2024-04-20T02:25:30.069 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.068+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aaf61f76:::benchmark_data_smithi171_44355_object2904:head, will try copies on 0,4 2024-04-20T02:25:30.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.093+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af55d4eb:::benchmark_data_smithi171_44355_object2516:head, will try copies on 0,4 2024-04-20T02:25:30.101 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.101+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:30.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.139+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:25:30.141 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.140+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e38a25ef:::benchmark_data_smithi171_44355_object930:head, will try copies on 0,4 2024-04-20T02:25:30.142 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.141+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:25:30.174 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.174+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae8a5898:::benchmark_data_smithi171_44355_object1021:head, will try copies on 0,4 2024-04-20T02:25:30.202 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.202+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:30.204 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.204+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:25:30.223 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.223+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:25:30.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.231+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:25:30.241 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.241+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:25:30.247 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.246+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca8d32d5:::benchmark_data_smithi171_44355_object2905:head, will try copies on 2,4 2024-04-20T02:25:30.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.261+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:25:30.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.289+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:25:30.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.310+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:25:30.334 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.334+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:25:30.352 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.352+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:25:30.376 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.376+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c37c8075:::benchmark_data_smithi171_44355_object2109:head, will try copies on 2,4 2024-04-20T02:25:30.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.383+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7b01206:::benchmark_data_smithi171_44355_object2907:head, will try copies on 0,4 2024-04-20T02:25:30.388 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.388+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:25:30.394 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.394+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7200ddd:::benchmark_data_smithi171_44355_object3826:head, will try copies on 2,4 2024-04-20T02:25:30.411 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.410+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:25:30.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.432+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:25:30.432 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.432+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a04cd27b:::benchmark_data_smithi171_44355_object3705:head, will try copies on 0,4 2024-04-20T02:25:30.444 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.444+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:25:30.479 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.478+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2a54918:::benchmark_data_smithi171_44355_object2257:head, will try copies on 0,4 2024-04-20T02:25:30.485 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.484+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:25:30.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.516+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7109fa5:::benchmark_data_smithi171_44355_object1115:head, will try copies on 2,4 2024-04-20T02:25:30.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.524+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e6c720:::benchmark_data_smithi171_44355_object2047:head, will try copies on 0,4 2024-04-20T02:25:30.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4b5c78e:::benchmark_data_smithi171_44355_object167:head, will try copies on 0,4 2024-04-20T02:25:30.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.545+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa90b138:::benchmark_data_smithi171_44355_object3905:head, will try copies on 0,4 2024-04-20T02:25:30.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 354 15 5068394 5068379 894.74 900.75 0.000909472 0.00110317 2024-04-20T02:25:30.564 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.563+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9650941:::benchmark_data_smithi171_44355_object764:head, will try copies on 0,4 2024-04-20T02:25:30.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.567+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:25:30.596 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.596+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef14ff20:::benchmark_data_smithi171_44355_object105:head, will try copies on 0,4 2024-04-20T02:25:30.607 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.607+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:25:30.610 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.609+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8e6dc:::benchmark_data_smithi171_44355_object4224:head, will try copies on 0,4 2024-04-20T02:25:30.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.613+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c843a726:::benchmark_data_smithi171_44355_object2589:head, will try copies on 2,4 2024-04-20T02:25:30.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.687+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edec7755:::benchmark_data_smithi171_44355_object3534:head, will try copies on 0,4 2024-04-20T02:25:30.688 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.687+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a26e0932:::benchmark_data_smithi171_44355_object1549:head, will try copies on 0,4 2024-04-20T02:25:30.718 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.717+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c04b02:::benchmark_data_smithi171_44355_object3825:head, will try copies on 0,4 2024-04-20T02:25:30.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.724+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c08ee549:::benchmark_data_smithi171_44355_object4106:head, will try copies on 2,4 2024-04-20T02:25:30.743 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.743+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:30.746 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.746+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e570c0d0:::benchmark_data_smithi171_44355_object22:head, will try copies on 0,4 2024-04-20T02:25:30.768 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.767+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:25:30.794 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.794+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1936c9e:::benchmark_data_smithi171_44355_object44:head, will try copies on 2,4 2024-04-20T02:25:30.796 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.795+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee6d53ee:::benchmark_data_smithi171_44355_object566:head, will try copies on 0,4 2024-04-20T02:25:30.837 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.837+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0731864:::benchmark_data_smithi171_44355_object1984:head, will try copies on 0,4 2024-04-20T02:25:30.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.849+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e325743c:::benchmark_data_smithi171_44355_object395:head, will try copies on 0,4 2024-04-20T02:25:30.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.851+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abf1ca63:::benchmark_data_smithi171_44355_object4317:head, will try copies on 0,4 2024-04-20T02:25:30.884 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.883+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:abe80ff8:::benchmark_data_smithi171_44355_object2062:head, will try copies on 0,4 2024-04-20T02:25:30.900 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.900+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:25:30.918 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.914+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a132fd78:::benchmark_data_smithi171_44355_object3783:head, will try copies on 0,4 2024-04-20T02:25:30.923 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.923+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c89d843c:::benchmark_data_smithi171_44355_object1165:head, will try copies on 2,4 2024-04-20T02:25:30.945 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.944+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c364a011:::benchmark_data_smithi171_44355_object248:head, will try copies on 2,4 2024-04-20T02:25:30.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.970+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2d39f14:::benchmark_data_smithi171_44355_object1935:head, will try copies on 2,4 2024-04-20T02:25:30.987 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.987+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd48e9a4:::benchmark_data_smithi171_44355_object3609:head, will try copies on 2,4 2024-04-20T02:25:30.998 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:30.998+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b768f2:::benchmark_data_smithi171_44355_object4341:head, will try copies on 0,4 2024-04-20T02:25:31.008 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.008+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cce35317:::benchmark_data_smithi171_44355_object382:head, will try copies on 2,4 2024-04-20T02:25:31.039 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.038+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cca092d2:::benchmark_data_smithi171_44355_object698:head, will try copies on 2,4 2024-04-20T02:25:31.054 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.054+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea96d258:::benchmark_data_smithi171_44355_object217:head, will try copies on 0,4 2024-04-20T02:25:31.060 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.060+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cef67f:::benchmark_data_smithi171_44355_object3249:head, will try copies on 2,4 2024-04-20T02:25:31.062 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.062+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb99625:::benchmark_data_smithi171_44355_object1929:head, will try copies on 0,4 2024-04-20T02:25:31.107 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.106+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1dcdaf0:::benchmark_data_smithi171_44355_object942:head, will try copies on 2,4 2024-04-20T02:25:31.121 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.120+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:25:31.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.127+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9c5e433:::benchmark_data_smithi171_44355_object1239:head, will try copies on 0,4 2024-04-20T02:25:31.130 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.130+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5d9ed6f:::benchmark_data_smithi171_44355_object3121:head, will try copies on 0,4 2024-04-20T02:25:31.156 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae7d27a6:::benchmark_data_smithi171_44355_object2411:head, will try copies on 0,4 2024-04-20T02:25:31.212 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.212+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:31.217 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.217+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eef5ffbb:::benchmark_data_smithi171_44355_object3868:head, will try copies on 0,4 2024-04-20T02:25:31.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.222+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a9a2b597:::benchmark_data_smithi171_44355_object1160:head, will try copies on 0,4 2024-04-20T02:25:31.254 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.253+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4731923:::benchmark_data_smithi171_44355_object1232:head, will try copies on 0,4 2024-04-20T02:25:31.262 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.261+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6cb29a5:::benchmark_data_smithi171_44355_object1999:head, will try copies on 0,4 2024-04-20T02:25:31.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.296+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1c8dcdf:::benchmark_data_smithi171_44355_object2472:head, will try copies on 0,4 2024-04-20T02:25:31.316 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.315+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:25:31.348 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.348+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd4df921:::benchmark_data_smithi171_44355_object859:head, will try copies on 2,4 2024-04-20T02:25:31.364 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.364+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a57c23b4:::benchmark_data_smithi171_44355_object3538:head, will try copies on 0,4 2024-04-20T02:25:31.382 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.382+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bc8451:::benchmark_data_smithi171_44355_object440:head, will try copies on 0,4 2024-04-20T02:25:31.391 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.390+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0fa0910:::benchmark_data_smithi171_44355_object3386:head, will try copies on 2,4 2024-04-20T02:25:31.408 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.406+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c80ed16c:::benchmark_data_smithi171_44355_object3529:head, will try copies on 2,4 2024-04-20T02:25:31.409 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.408+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa3849fc:::benchmark_data_smithi171_44355_object3694:head, will try copies on 0,4 2024-04-20T02:25:31.433 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.433+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5c8bdbf:::benchmark_data_smithi171_44355_object497:head, will try copies on 0,4 2024-04-20T02:25:31.435 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.435+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a20194f9:::benchmark_data_smithi171_44355_object96:head, will try copies on 0,4 2024-04-20T02:25:31.440 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.440+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c73a4df7:::benchmark_data_smithi171_44355_object933:head, will try copies on 2,4 2024-04-20T02:25:31.456 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.455+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e80ea3f7:::benchmark_data_smithi171_44355_object2695:head, will try copies on 0,4 2024-04-20T02:25:31.475 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.475+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:25:31.489 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.489+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:25:31.518 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.517+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c095a429:::benchmark_data_smithi171_44355_object3491:head, will try copies on 2,4 2024-04-20T02:25:31.524 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.524+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2bbf0be:::benchmark_data_smithi171_44355_object147:head, will try copies on 0,4 2024-04-20T02:25:31.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 355 16 5082984 5082968 894.788 911.812 0.0012775 0.00110311 2024-04-20T02:25:31.562 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.562+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acba464d:::benchmark_data_smithi171_44355_object594:head, will try copies on 0,4 2024-04-20T02:25:31.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.566+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:31.605 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.605+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c61d4cb5:::benchmark_data_smithi171_44355_object3678:head, will try copies on 2,4 2024-04-20T02:25:31.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:25:31.613 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.612+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af336b8d:::benchmark_data_smithi171_44355_object2339:head, will try copies on 0,4 2024-04-20T02:25:31.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.625+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cdb54af4:::benchmark_data_smithi171_44355_object2031:head, will try copies on 2,4 2024-04-20T02:25:31.642 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.641+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4421667:::benchmark_data_smithi171_44355_object2746:head, will try copies on 0,4 2024-04-20T02:25:31.644 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.643+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c63b50a1:::benchmark_data_smithi171_44355_object3918:head, will try copies on 2,4 2024-04-20T02:25:31.664 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.663+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb94868b:::benchmark_data_smithi171_44355_object183:head, will try copies on 0,4 2024-04-20T02:25:31.667 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.667+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:25:31.687 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.687+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4d1a06d:::benchmark_data_smithi171_44355_object2723:head, will try copies on 0,4 2024-04-20T02:25:31.754 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.753+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ebf90d56:::benchmark_data_smithi171_44355_object2200:head, will try copies on 0,4 2024-04-20T02:25:31.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.756+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0ba94c9:::benchmark_data_smithi171_44355_object627:head, will try copies on 0,4 2024-04-20T02:25:31.765 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.765+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3189b5:::benchmark_data_smithi171_44355_object3723:head, will try copies on 2,4 2024-04-20T02:25:31.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.772+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e25fe433:::benchmark_data_smithi171_44355_object3265:head, will try copies on 0,4 2024-04-20T02:25:31.804 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.804+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cdbe48:::benchmark_data_smithi171_44355_object1941:head, will try copies on 2,4 2024-04-20T02:25:31.809 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.809+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:25:31.813 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.812+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:25:31.851 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.851+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9d1385e:::benchmark_data_smithi171_44355_object3988:head, will try copies on 2,4 2024-04-20T02:25:31.861 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.860+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb55741b:::benchmark_data_smithi171_44355_object1122:head, will try copies on 0,4 2024-04-20T02:25:31.867 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.867+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:31.907 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.906+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:25:31.921 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.921+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c44390de:::benchmark_data_smithi171_44355_object489:head, will try copies on 2,4 2024-04-20T02:25:31.941 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.940+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:25:31.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.952+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e90501:::benchmark_data_smithi171_44355_object1806:head, will try copies on 0,4 2024-04-20T02:25:31.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.956+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec07b1c4:::benchmark_data_smithi171_44355_object732:head, will try copies on 0,4 2024-04-20T02:25:31.974 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.974+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cecb52f6:::benchmark_data_smithi171_44355_object192:head, will try copies on 2,4 2024-04-20T02:25:31.975 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.975+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:25:31.992 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:31.991+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6099e0f:::benchmark_data_smithi171_44355_object1314:head, will try copies on 2,4 2024-04-20T02:25:32.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.005+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:25:32.016 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.016+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2cf76e0:::benchmark_data_smithi171_44355_object4097:head, will try copies on 2,4 2024-04-20T02:25:32.043 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.042+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1b30e18:::benchmark_data_smithi171_44355_object3652:head, will try copies on 0,4 2024-04-20T02:25:32.058 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.058+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3e62f0:::benchmark_data_smithi171_44355_object3683:head, will try copies on 2,4 2024-04-20T02:25:32.061 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.060+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:25:32.066 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.065+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f7faa6:::benchmark_data_smithi171_44355_object4127:head, will try copies on 0,4 2024-04-20T02:25:32.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.090+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:25:32.117 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.117+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:25:32.118 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.117+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:25:32.150 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.150+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4313858:::benchmark_data_smithi171_44355_object3307:head, will try copies on 2,4 2024-04-20T02:25:32.173 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.172+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c853c806:::benchmark_data_smithi171_44355_object2644:head, will try copies on 2,4 2024-04-20T02:25:32.185 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.184+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e306e6b4:::benchmark_data_smithi171_44355_object3555:head, will try copies on 0,4 2024-04-20T02:25:32.221 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.220+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4d87705:::benchmark_data_smithi171_44355_object2740:head, will try copies on 2,4 2024-04-20T02:25:32.234 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.233+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a86361b6:::benchmark_data_smithi171_44355_object4345:head, will try copies on 0,4 2024-04-20T02:25:32.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.237+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:25:32.255 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.255+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c25ea08b:::benchmark_data_smithi171_44355_object236:head, will try copies on 2,4 2024-04-20T02:25:32.266 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.266+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e55c24b7:::benchmark_data_smithi171_44355_object659:head, will try copies on 0,4 2024-04-20T02:25:32.274 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.274+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c616ca43:::benchmark_data_smithi171_44355_object3325:head, will try copies on 2,4 2024-04-20T02:25:32.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.280+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5622d47:::benchmark_data_smithi171_44355_object215:head, will try copies on 0,4 2024-04-20T02:25:32.289 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.289+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:25:32.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.310+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:25:32.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.314+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9cde18b:::benchmark_data_smithi171_44355_object3861:head, will try copies on 2,4 2024-04-20T02:25:32.325 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.325+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:25:32.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.357+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5bb5eaf:::benchmark_data_smithi171_44355_object3497:head, will try copies on 2,4 2024-04-20T02:25:32.372 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.372+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:25:32.374 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.374+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed74d070:::benchmark_data_smithi171_44355_object3601:head, will try copies on 0,4 2024-04-20T02:25:32.401 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:25:32.405 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.404+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8a8e92e:::benchmark_data_smithi171_44355_object3349:head, will try copies on 0,4 2024-04-20T02:25:32.415 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.415+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c449ad54:::benchmark_data_smithi171_44355_object3203:head, will try copies on 2,4 2024-04-20T02:25:32.454 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.453+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e297e701:::benchmark_data_smithi171_44355_object670:head, will try copies on 0,4 2024-04-20T02:25:32.464 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.464+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:25:32.474 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.474+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c714efdb:::benchmark_data_smithi171_44355_object720:head, will try copies on 2,4 2024-04-20T02:25:32.484 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.484+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:25:32.500 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.500+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5542c89:::benchmark_data_smithi171_44355_object1611:head, will try copies on 2,4 2024-04-20T02:25:32.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.501+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea520639:::benchmark_data_smithi171_44355_object3094:head, will try copies on 0,4 2024-04-20T02:25:32.521 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.520+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c4b37713:::benchmark_data_smithi171_44355_object1627:head, will try copies on 2,4 2024-04-20T02:25:32.530 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.530+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb0cb4d1:::benchmark_data_smithi171_44355_object398:head, will try copies on 0,4 2024-04-20T02:25:32.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.533+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1ea30d2:::benchmark_data_smithi171_44355_object3732:head, will try copies on 0,4 2024-04-20T02:25:32.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 356 16 5097275 5097259 894.783 893.188 0.000741407 0.00110312 2024-04-20T02:25:32.563 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.563+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c120873e:::benchmark_data_smithi171_44355_object2839:head, will try copies on 2,4 2024-04-20T02:25:32.567 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.566+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a51a8c9d:::benchmark_data_smithi171_44355_object1878:head, will try copies on 0,4 2024-04-20T02:25:32.574 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.574+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7bb9f2d:::benchmark_data_smithi171_44355_object3793:head, will try copies on 0,4 2024-04-20T02:25:32.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.600+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:25:32.606 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.606+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2795954:::benchmark_data_smithi171_44355_object1265:head, will try copies on 0,4 2024-04-20T02:25:32.643 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.643+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5a0eef0:::benchmark_data_smithi171_44355_object1209:head, will try copies on 2,4 2024-04-20T02:25:32.645 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.645+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb8cd535:::benchmark_data_smithi171_44355_object3675:head, will try copies on 0,4 2024-04-20T02:25:32.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.648+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a068b5a7:::benchmark_data_smithi171_44355_object611:head, will try copies on 0,4 2024-04-20T02:25:32.669 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.669+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:25:32.670 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.670+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0050641:::benchmark_data_smithi171_44355_object1332:head, will try copies on 2,4 2024-04-20T02:25:32.702 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.702+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7712e0f:::benchmark_data_smithi171_44355_object853:head, will try copies on 0,4 2024-04-20T02:25:32.715 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.714+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3471264:::benchmark_data_smithi171_44355_object3521:head, will try copies on 0,4 2024-04-20T02:25:32.728 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.727+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:25:32.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.734+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:25:32.742 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.742+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5971538:::benchmark_data_smithi171_44355_object483:head, will try copies on 0,4 2024-04-20T02:25:32.756 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.755+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:25:32.772 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.772+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:25:32.824 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.823+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca6345d7:::benchmark_data_smithi171_44355_object3405:head, will try copies on 2,4 2024-04-20T02:25:32.831 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.829+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a10f09ed:::benchmark_data_smithi171_44355_object3978:head, will try copies on 0,4 2024-04-20T02:25:32.850 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.849+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a07b61ba:::benchmark_data_smithi171_44355_object1620:head, will try copies on 0,4 2024-04-20T02:25:32.872 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.872+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc23ff76:::benchmark_data_smithi171_44355_object3032:head, will try copies on 2,4 2024-04-20T02:25:32.893 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.893+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8632f68:::benchmark_data_smithi171_44355_object2782:head, will try copies on 0,4 2024-04-20T02:25:32.924 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.924+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:25:32.939 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.939+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c07ab34f:::benchmark_data_smithi171_44355_object1062:head, will try copies on 2,4 2024-04-20T02:25:32.956 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.955+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed56cb51:::benchmark_data_smithi171_44355_object1376:head, will try copies on 0,4 2024-04-20T02:25:32.973 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.973+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac6ebb0f:::benchmark_data_smithi171_44355_object3097:head, will try copies on 0,4 2024-04-20T02:25:32.997 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:32.997+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:25:33.011 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.010+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c9fe1340:::benchmark_data_smithi171_44355_object3038:head, will try copies on 2,4 2024-04-20T02:25:33.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.028+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:25:33.047 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.046+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8b8afa9:::benchmark_data_smithi171_44355_object141:head, will try copies on 2,4 2024-04-20T02:25:33.059 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.059+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb8b3d24:::benchmark_data_smithi171_44355_object2403:head, will try copies on 2,4 2024-04-20T02:25:33.065 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.065+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:25:33.086 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.086+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a0032e82:::benchmark_data_smithi171_44355_object2483:head, will try copies on 0,4 2024-04-20T02:25:33.189 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.189+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:af8d4350:::benchmark_data_smithi171_44355_object1710:head, will try copies on 0,4 2024-04-20T02:25:33.196 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.196+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:25:33.249 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.249+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:25:33.268 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.268+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a22c551b:::benchmark_data_smithi171_44355_object3402:head, will try copies on 0,4 2024-04-20T02:25:33.327 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.326+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:25:33.350 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.349+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c22f8722:::benchmark_data_smithi171_44355_object622:head, will try copies on 2,4 2024-04-20T02:25:33.397 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.397+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:25:33.452 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.451+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:25:33.465 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.465+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf61aee2:::benchmark_data_smithi171_44355_object408:head, will try copies on 2,4 2024-04-20T02:25:33.477 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.477+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e48d0d6e:::benchmark_data_smithi171_44355_object1509:head, will try copies on 0,4 2024-04-20T02:25:33.495 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.495+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a8d6884e:::benchmark_data_smithi171_44355_object3292:head, will try copies on 0,4 2024-04-20T02:25:33.498 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.498+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c759eafe:::benchmark_data_smithi171_44355_object2270:head, will try copies on 2,4 2024-04-20T02:25:33.499 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.499+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1543045:::benchmark_data_smithi171_44355_object607:head, will try copies on 0,4 2024-04-20T02:25:33.529 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.529+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7f254e6:::benchmark_data_smithi171_44355_object3312:head, will try copies on 2,4 2024-04-20T02:25:33.534 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.534+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e984773b:::benchmark_data_smithi171_44355_object15:head, will try copies on 0,4 2024-04-20T02:25:33.546 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.546+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7e7182b:::benchmark_data_smithi171_44355_object2681:head, will try copies on 2,4 2024-04-20T02:25:33.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 357 16 5110890 5110874 894.66 850.938 0.000822699 0.00110327 2024-04-20T02:25:33.581 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.580+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc4c35d:::benchmark_data_smithi171_44355_object462:head, will try copies on 0,4 2024-04-20T02:25:33.600 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.600+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c33e5923:::benchmark_data_smithi171_44355_object1831:head, will try copies on 2,4 2024-04-20T02:25:33.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.602+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a5ec7c60:::benchmark_data_smithi171_44355_object188:head, will try copies on 0,4 2024-04-20T02:25:33.626 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.626+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2230981:::benchmark_data_smithi171_44355_object3883:head, will try copies on 0,4 2024-04-20T02:25:33.631 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.631+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c95294a5:::benchmark_data_smithi171_44355_object4231:head, will try copies on 2,4 2024-04-20T02:25:33.638 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.638+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2adee84:::benchmark_data_smithi171_44355_object3523:head, will try copies on 0,4 2024-04-20T02:25:33.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.648+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afef49ee:::benchmark_data_smithi171_44355_object12:head, will try copies on 0,4 2024-04-20T02:25:33.671 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.670+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ca0387:::benchmark_data_smithi171_44355_object1471:head, will try copies on 0,4 2024-04-20T02:25:33.714 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.714+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e21ce1d7:::benchmark_data_smithi171_44355_object517:head, will try copies on 0,4 2024-04-20T02:25:33.716 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.715+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c50fa3af:::benchmark_data_smithi171_44355_object2533:head, will try copies on 2,4 2024-04-20T02:25:33.731 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.731+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e7312681:::benchmark_data_smithi171_44355_object448:head, will try copies on 0,4 2024-04-20T02:25:33.735 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.735+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a06d8d1a:::benchmark_data_smithi171_44355_object4199:head, will try copies on 0,4 2024-04-20T02:25:33.741 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.741+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb7aa517:::benchmark_data_smithi171_44355_object826:head, will try copies on 2,4 2024-04-20T02:25:33.775 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.774+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c726578f:::benchmark_data_smithi171_44355_object538:head, will try copies on 2,4 2024-04-20T02:25:33.791 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.791+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a220000a:::benchmark_data_smithi171_44355_object1382:head, will try copies on 0,4 2024-04-20T02:25:33.799 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.797+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e434668a:::benchmark_data_smithi171_44355_object2924:head, will try copies on 0,4 2024-04-20T02:25:33.822 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.822+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:25:33.823 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.822+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ab27916b:::benchmark_data_smithi171_44355_object3769:head, will try copies on 0,4 2024-04-20T02:25:33.834 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.833+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e43b8df9:::benchmark_data_smithi171_44355_object3991:head, will try copies on 0,4 2024-04-20T02:25:33.870 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.870+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6f61cfd:::benchmark_data_smithi171_44355_object4219:head, will try copies on 0,4 2024-04-20T02:25:33.871 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.870+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7612175:::benchmark_data_smithi171_44355_object2881:head, will try copies on 0,4 2024-04-20T02:25:33.878 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.878+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:25:33.888 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.888+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4a52a49:::benchmark_data_smithi171_44355_object224:head, will try copies on 0,4 2024-04-20T02:25:33.912 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.912+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a468a0ef:::benchmark_data_smithi171_44355_object3189:head, will try copies on 0,4 2024-04-20T02:25:33.970 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.969+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c827ea2a:::benchmark_data_smithi171_44355_object2007:head, will try copies on 2,4 2024-04-20T02:25:33.977 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.977+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32ac336:::benchmark_data_smithi171_44355_object2848:head, will try copies on 0,4 2024-04-20T02:25:33.999 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:33.998+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7b160f:::benchmark_data_smithi171_44355_object3382:head, will try copies on 0,4 2024-04-20T02:25:34.028 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.028+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:25:34.040 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.040+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8dca2c7:::benchmark_data_smithi171_44355_object3004:head, will try copies on 2,4 2024-04-20T02:25:34.070 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.070+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:afda1b58:::benchmark_data_smithi171_44355_object2356:head, will try copies on 0,4 2024-04-20T02:25:34.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.072+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c27d4ff9:::benchmark_data_smithi171_44355_object4338:head, will try copies on 2,4 2024-04-20T02:25:34.090 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.090+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae0015e2:::benchmark_data_smithi171_44355_object178:head, will try copies on 0,4 2024-04-20T02:25:34.108 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.108+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e6b3123c:::benchmark_data_smithi171_44355_object4236:head, will try copies on 0,4 2024-04-20T02:25:34.114 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.112+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf0e6784:::benchmark_data_smithi171_44355_object3120:head, will try copies on 2,4 2024-04-20T02:25:34.122 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.122+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a87049e4:::benchmark_data_smithi171_44355_object2663:head, will try copies on 0,4 2024-04-20T02:25:34.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.128+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef0ec652:::benchmark_data_smithi171_44355_object3913:head, will try copies on 0,4 2024-04-20T02:25:34.135 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.135+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd1b0ca6:::benchmark_data_smithi171_44355_object3822:head, will try copies on 2,4 2024-04-20T02:25:34.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.156+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7c096d6:::benchmark_data_smithi171_44355_object477:head, will try copies on 0,4 2024-04-20T02:25:34.163 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.163+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c920658f:::benchmark_data_smithi171_44355_object3046:head, will try copies on 2,4 2024-04-20T02:25:34.213 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.213+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca3d2aa2:::benchmark_data_smithi171_44355_object2463:head, will try copies on 2,4 2024-04-20T02:25:34.231 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.231+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c54a811a:::benchmark_data_smithi171_44355_object4291:head, will try copies on 2,4 2024-04-20T02:25:34.232 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.231+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4ed4f5c:::benchmark_data_smithi171_44355_object1340:head, will try copies on 0,4 2024-04-20T02:25:34.294 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.294+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5b6ac11:::benchmark_data_smithi171_44355_object3298:head, will try copies on 0,4 2024-04-20T02:25:34.301 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.301+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5cffcc2:::benchmark_data_smithi171_44355_object1437:head, will try copies on 2,4 2024-04-20T02:25:34.307 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.307+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:edf06956:::benchmark_data_smithi171_44355_object9:head, will try copies on 0,4 2024-04-20T02:25:34.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e59e90ce:::benchmark_data_smithi171_44355_object3245:head, will try copies on 0,4 2024-04-20T02:25:34.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.400+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cbd9a988:::benchmark_data_smithi171_44355_object3879:head, will try copies on 2,4 2024-04-20T02:25:34.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.400+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc55508:::benchmark_data_smithi171_44355_object3789:head, will try copies on 0,4 2024-04-20T02:25:34.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.501+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a186ef64:::benchmark_data_smithi171_44355_object2362:head, will try copies on 0,4 2024-04-20T02:25:34.517 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.517+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd5a0e2b:::benchmark_data_smithi171_44355_object4254:head, will try copies on 2,4 2024-04-20T02:25:34.525 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.524+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9f35daa:::benchmark_data_smithi171_44355_object1885:head, will try copies on 0,4 2024-04-20T02:25:34.551 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.550+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:25:34.558 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.557+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a081f3b9:::benchmark_data_smithi171_44355_object869:head, will try copies on 0,4 2024-04-20T02:25:34.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 358 16 5124754 5124738 894.581 866.5 0.000981773 0.00110337 2024-04-20T02:25:34.568 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.567+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce9551c7:::benchmark_data_smithi171_44355_object792:head, will try copies on 2,4 2024-04-20T02:25:34.584 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.583+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c2e2fff9:::benchmark_data_smithi171_44355_object3267:head, will try copies on 2,4 2024-04-20T02:25:34.591 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.590+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bc811d:::benchmark_data_smithi171_44355_object1020:head, will try copies on 0,4 2024-04-20T02:25:34.602 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.602+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5fd3919:::benchmark_data_smithi171_44355_object1701:head, will try copies on 2,4 2024-04-20T02:25:34.633 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.633+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1fb6fd7:::benchmark_data_smithi171_44355_object3246:head, will try copies on 0,4 2024-04-20T02:25:34.648 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.647+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e62ae2d9:::benchmark_data_smithi171_44355_object1560:head, will try copies on 0,4 2024-04-20T02:25:34.677 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.677+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ca4eb826:::benchmark_data_smithi171_44355_object2477:head, will try copies on 2,4 2024-04-20T02:25:34.700 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.699+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed4f9b2e:::benchmark_data_smithi171_44355_object743:head, will try copies on 0,4 2024-04-20T02:25:34.719 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.719+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cddb148a:::benchmark_data_smithi171_44355_object4278:head, will try copies on 2,4 2024-04-20T02:25:34.737 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.736+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e3c47115:::benchmark_data_smithi171_44355_object700:head, will try copies on 0,4 2024-04-20T02:25:34.758 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.758+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a12497f0:::benchmark_data_smithi171_44355_object2045:head, will try copies on 0,4 2024-04-20T02:25:34.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.785+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:25:34.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.797+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ed93413b:::benchmark_data_smithi171_44355_object4023:head, will try copies on 0,4 2024-04-20T02:25:34.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.806+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3c38867:::benchmark_data_smithi171_44355_object2914:head, will try copies on 2,4 2024-04-20T02:25:34.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.822+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c5df2021:::benchmark_data_smithi171_44355_object3608:head, will try copies on 2,4 2024-04-20T02:25:34.830 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.828+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2d9bd82:::benchmark_data_smithi171_44355_object333:head, will try copies on 0,4 2024-04-20T02:25:34.855 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.855+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aa387789:::benchmark_data_smithi171_44355_object1033:head, will try copies on 0,4 2024-04-20T02:25:34.860 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.859+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c393166a:::benchmark_data_smithi171_44355_object1524:head, will try copies on 2,4 2024-04-20T02:25:34.879 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.879+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c6c94f89:::benchmark_data_smithi171_44355_object840:head, will try copies on 2,4 2024-04-20T02:25:34.895 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.895+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:25:34.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.924+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1793935:::benchmark_data_smithi171_44355_object1873:head, will try copies on 2,4 2024-04-20T02:25:34.926 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.924+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a61b78dc:::benchmark_data_smithi171_44355_object275:head, will try copies on 0,4 2024-04-20T02:25:34.957 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.957+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e2b90e6e:::benchmark_data_smithi171_44355_object781:head, will try copies on 0,4 2024-04-20T02:25:34.965 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.964+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cc676fc6:::benchmark_data_smithi171_44355_object2211:head, will try copies on 2,4 2024-04-20T02:25:34.983 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.982+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:25:34.986 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:34.986+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c32bf028:::benchmark_data_smithi171_44355_object4295:head, will try copies on 2,4 2024-04-20T02:25:35.002 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.002+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ae36296d:::benchmark_data_smithi171_44355_object844:head, will try copies on 0,4 2024-04-20T02:25:35.013 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.013+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:25:35.027 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.027+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7c56fb3:::benchmark_data_smithi171_44355_object3667:head, will try copies on 2,4 2024-04-20T02:25:35.034 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.034+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7bd6ce1:::benchmark_data_smithi171_44355_object799:head, will try copies on 0,4 2024-04-20T02:25:35.072 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.071+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e22f7ef6:::benchmark_data_smithi171_44355_object1297:head, will try copies on 0,4 2024-04-20T02:25:35.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.079+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:25:35.097 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.096+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3dadcc6:::benchmark_data_smithi171_44355_object495:head, will try copies on 2,4 2024-04-20T02:25:35.113 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.113+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ea2a3fec:::benchmark_data_smithi171_44355_object457:head, will try copies on 0,4 2024-04-20T02:25:35.127 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.126+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4d331dc:::benchmark_data_smithi171_44355_object3005:head, will try copies on 0,4 2024-04-20T02:25:35.138 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.138+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e391676a:::benchmark_data_smithi171_44355_object2658:head, will try copies on 0,4 2024-04-20T02:25:35.140 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.140+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb964839:::benchmark_data_smithi171_44355_object1420:head, will try copies on 2,4 2024-04-20T02:25:35.157 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.156+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e575e29a:::benchmark_data_smithi171_44355_object3912:head, will try copies on 0,4 2024-04-20T02:25:35.162 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.161+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acad4949:::benchmark_data_smithi171_44355_object4107:head, will try copies on 0,4 2024-04-20T02:25:35.175 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.174+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cda09ec5:::benchmark_data_smithi171_44355_object738:head, will try copies on 2,4 2024-04-20T02:25:35.206 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.205+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4782478:::benchmark_data_smithi171_44355_object2057:head, will try copies on 0,4 2024-04-20T02:25:35.224 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.224+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c505f78c:::benchmark_data_smithi171_44355_object3636:head, will try copies on 2,4 2024-04-20T02:25:35.280 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.279+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9e953b9:::benchmark_data_smithi171_44355_object1261:head, will try copies on 0,4 2024-04-20T02:25:35.297 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.294+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a384a79d:::benchmark_data_smithi171_44355_object906:head, will try copies on 0,4 2024-04-20T02:25:35.351 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.350+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ef21129f:::benchmark_data_smithi171_44355_object4001:head, will try copies on 0,4 2024-04-20T02:25:35.357 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.355+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7aa2997:::benchmark_data_smithi171_44355_object1163:head, will try copies on 0,4 2024-04-20T02:25:35.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.379+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb31a1cb:::benchmark_data_smithi171_44355_object1457:head, will try copies on 2,4 2024-04-20T02:25:35.380 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.380+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e72e7288:::benchmark_data_smithi171_44355_object3944:head, will try copies on 0,4 2024-04-20T02:25:35.427 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.427+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ad7166d0:::benchmark_data_smithi171_44355_object4000:head, will try copies on 0,4 2024-04-20T02:25:35.436 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.436+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e67e9928:::benchmark_data_smithi171_44355_object2637:head, will try copies on 0,4 2024-04-20T02:25:35.486 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.486+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a2c74798:::benchmark_data_smithi171_44355_object1371:head, will try copies on 0,4 2024-04-20T02:25:35.488 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.488+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3fb53c4:::benchmark_data_smithi171_44355_object760:head, will try copies on 2,4 2024-04-20T02:25:35.510 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.509+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4fbea16:::benchmark_data_smithi171_44355_object3542:head, will try copies on 0,4 2024-04-20T02:25:35.533 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.533+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb73c186:::benchmark_data_smithi171_44355_object3392:head, will try copies on 0,4 2024-04-20T02:25:35.556 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.555+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:efd74894:::benchmark_data_smithi171_44355_object437:head, will try copies on 0,4 2024-04-20T02:25:35.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout: 359 16 5139575 5139559 894.669 926.312 0.00111341 0.00110326 2024-04-20T02:25:35.566 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.566+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4421614:::benchmark_data_smithi171_44355_object1083:head, will try copies on 0,4 2024-04-20T02:25:35.592 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.592+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cd36af2c:::benchmark_data_smithi171_44355_object3436:head, will try copies on 2,4 2024-04-20T02:25:35.594 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.594+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e32eab35:::benchmark_data_smithi171_44355_object348:head, will try copies on 0,4 2024-04-20T02:25:35.663 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.663+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a4e7b484:::benchmark_data_smithi171_44355_object1922:head, will try copies on 0,4 2024-04-20T02:25:35.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.697+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e250414a:::benchmark_data_smithi171_44355_object3128:head, will try copies on 0,4 2024-04-20T02:25:35.698 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.698+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8741332:::benchmark_data_smithi171_44355_object3012:head, will try copies on 2,4 2024-04-20T02:25:35.717 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.717+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:eb1b19e3:::benchmark_data_smithi171_44355_object2490:head, will try copies on 0,4 2024-04-20T02:25:35.724 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.723+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:acb887b4:::benchmark_data_smithi171_44355_object3074:head, will try copies on 0,4 2024-04-20T02:25:35.736 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.735+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cad9d9c0:::benchmark_data_smithi171_44355_object714:head, will try copies on 2,4 2024-04-20T02:25:35.739 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.738+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec9d1264:::benchmark_data_smithi171_44355_object1474:head, will try copies on 0,4 2024-04-20T02:25:35.760 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.760+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0df8fc0:::benchmark_data_smithi171_44355_object879:head, will try copies on 2,4 2024-04-20T02:25:35.767 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.767+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e4c3d36a:::benchmark_data_smithi171_44355_object3370:head, will try copies on 0,4 2024-04-20T02:25:35.769 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.769+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a098294e:::benchmark_data_smithi171_44355_object2518:head, will try copies on 0,4 2024-04-20T02:25:35.786 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.785+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecc20223:::benchmark_data_smithi171_44355_object2098:head, will try copies on 0,4 2024-04-20T02:25:35.793 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.793+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c0676ea4:::benchmark_data_smithi171_44355_object2525:head, will try copies on 2,4 2024-04-20T02:25:35.801 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.800+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a75933e6:::benchmark_data_smithi171_44355_object3511:head, will try copies on 0,4 2024-04-20T02:25:35.812 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.812+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e0534c1d:::benchmark_data_smithi171_44355_object3576:head, will try copies on 0,4 2024-04-20T02:25:35.821 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.820+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfc37a84:::benchmark_data_smithi171_44355_object4067:head, will try copies on 2,4 2024-04-20T02:25:35.829 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.829+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1af6cb4:::benchmark_data_smithi171_44355_object1475:head, will try copies on 0,4 2024-04-20T02:25:35.848 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.847+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c949788d:::benchmark_data_smithi171_44355_object4181:head, will try copies on 2,4 2024-04-20T02:25:35.866 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.865+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf5df107:::benchmark_data_smithi171_44355_object2262:head, will try copies on 2,4 2024-04-20T02:25:35.891 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.890+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee7835b6:::benchmark_data_smithi171_44355_object3085:head, will try copies on 0,4 2024-04-20T02:25:35.953 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.952+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c7d32a30:::benchmark_data_smithi171_44355_object414:head, will try copies on 2,4 2024-04-20T02:25:35.968 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.968+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a38d2b7d:::benchmark_data_smithi171_44355_object2296:head, will try copies on 0,4 2024-04-20T02:25:35.979 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:35.979+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c51bfffc:::benchmark_data_smithi171_44355_object2960:head, will try copies on 2,4 2024-04-20T02:25:36.006 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.006+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a81f0d8b:::benchmark_data_smithi171_44355_object586:head, will try copies on 0,4 2024-04-20T02:25:36.045 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.044+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ecb55119:::benchmark_data_smithi171_44355_object4128:head, will try copies on 0,4 2024-04-20T02:25:36.079 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.078+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:add0882e:::benchmark_data_smithi171_44355_object357:head, will try copies on 0,4 2024-04-20T02:25:36.088 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.088+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cf8aaffa:::benchmark_data_smithi171_44355_object2496:head, will try copies on 2,4 2024-04-20T02:25:36.094 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.093+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:ac78fa1f:::benchmark_data_smithi171_44355_object570:head, will try copies on 0,4 2024-04-20T02:25:36.128 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.128+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a606f6f7:::benchmark_data_smithi171_44355_object2522:head, will try copies on 0,4 2024-04-20T02:25:36.133 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.133+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c49773e4:::benchmark_data_smithi171_44355_object4164:head, will try copies on 2,4 2024-04-20T02:25:36.151 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.150+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e52d51fe:::benchmark_data_smithi171_44355_object2272:head, will try copies on 0,4 2024-04-20T02:25:36.171 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.171+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1e846c2:::benchmark_data_smithi171_44355_object3561:head, will try copies on 2,4 2024-04-20T02:25:36.187 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.187+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aec16a5b:::benchmark_data_smithi171_44355_object4099:head, will try copies on 0,4 2024-04-20T02:25:36.188 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.188+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ec223d47:::benchmark_data_smithi171_44355_object1793:head, will try copies on 0,4 2024-04-20T02:25:36.214 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.213+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1303073:::benchmark_data_smithi171_44355_object3153:head, will try copies on 0,4 2024-04-20T02:25:36.222 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.221+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c57043e7:::benchmark_data_smithi171_44355_object4049:head, will try copies on 2,4 2024-04-20T02:25:36.238 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.238+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:aed50213:::benchmark_data_smithi171_44355_object551:head, will try copies on 0,4 2024-04-20T02:25:36.239 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.239+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:ee639138:::benchmark_data_smithi171_44355_object1847:head, will try copies on 0,4 2024-04-20T02:25:36.257 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.256+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cb88d3c2:::benchmark_data_smithi171_44355_object4268:head, will try copies on 2,4 2024-04-20T02:25:36.264 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.263+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e8ad7b04:::benchmark_data_smithi171_44355_object1319:head, will try copies on 0,4 2024-04-20T02:25:36.276 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.275+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a74324b0:::benchmark_data_smithi171_44355_object2940:head, will try copies on 0,4 2024-04-20T02:25:36.291 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.291+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c8cb1b08:::benchmark_data_smithi171_44355_object1667:head, will try copies on 2,4 2024-04-20T02:25:36.311 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.311+0000 7ff4330b7700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e1fa707d:::benchmark_data_smithi171_44355_object2548:head, will try copies on 0,4 2024-04-20T02:25:36.314 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.314+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c791353d:::benchmark_data_smithi171_44355_object3674:head, will try copies on 2,4 2024-04-20T02:25:36.342 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.341+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cfce3b98:::benchmark_data_smithi171_44355_object2439:head, will try copies on 2,4 2024-04-20T02:25:36.343 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.343+0000 7ff4340b9700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a3b0d5ad:::benchmark_data_smithi171_44355_object1540:head, will try copies on 0,4 2024-04-20T02:25:36.383 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.383+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c1d142eb:::benchmark_data_smithi171_44355_object510:head, will try copies on 2,4 2024-04-20T02:25:36.384 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.383+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e5e44e47:::benchmark_data_smithi171_44355_object750:head, will try copies on 0,4 2024-04-20T02:25:36.393 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.393+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a7260494:::benchmark_data_smithi171_44355_object2442:head, will try copies on 0,4 2024-04-20T02:25:36.400 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.400+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce48fc09:::benchmark_data_smithi171_44355_object988:head, will try copies on 2,4 2024-04-20T02:25:36.421 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.421+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e9213433:::benchmark_data_smithi171_44355_object1650:head, will try copies on 0,4 2024-04-20T02:25:36.422 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.422+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a1885dc3:::benchmark_data_smithi171_44355_object1784:head, will try copies on 0,4 2024-04-20T02:25:36.439 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.438+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c3bc1d1b:::benchmark_data_smithi171_44355_object3400:head, will try copies on 2,4 2024-04-20T02:25:36.458 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.458+0000 7ff4350bb700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:cff1a7b4:::benchmark_data_smithi171_44355_object3940:head, will try copies on 2,4 2024-04-20T02:25:36.481 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.481+0000 7ff4380c1700 -1 log_channel(cluster) log [ERR] : 2.5 missing primary copy of 2:a002e37b:::benchmark_data_smithi171_44355_object4009:head, will try copies on 0,4 2024-04-20T02:25:36.501 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.501+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:ce67f352:::benchmark_data_smithi171_44355_object3209:head, will try copies on 2,4 2024-04-20T02:25:36.514 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.514+0000 7ff4370bf700 -1 log_channel(cluster) log [ERR] : 2.7 missing primary copy of 2:e648bbeb:::benchmark_data_smithi171_44355_object3222:head, will try copies on 0,4 2024-04-20T02:25:36.515 INFO:tasks.ceph.osd.1.smithi117.stderr:2024-04-20T02:25:36.515+0000 7ff4390c3700 -1 log_channel(cluster) log [ERR] : 2.3 missing primary copy of 2:c111d2d0:::benchmark_data_smithi171_44355_object2563:head, will try copies on 2,4 2024-04-20T02:25:36.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Total time run: 360.008 2024-04-20T02:25:36.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Total reads made: 5153505 2024-04-20T02:25:36.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Read size: 65536 2024-04-20T02:25:36.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Object size: 1048576 2024-04-20T02:25:36.559 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Bandwidth (MB/sec): 894.685 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Average IOPS: 14314 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Stddev IOPS: 518.193 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Max IOPS: 15028 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Min IOPS: 11762 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Average Latency(s): 0.00110322 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Max latency(s): 0.343331 2024-04-20T02:25:36.560 INFO:tasks.radosbench.radosbench.0.smithi171.stdout:Min latency(s): 0.000210708 2024-04-20T02:25:42.542 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-04-20T02:25:42.542 INFO:teuthology.task.exec:Executing custom commands... 2024-04-20T02:25:42.543 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:25:42.543 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0' 2024-04-20T02:25:42.938 INFO:teuthology.orchestra.run.smithi171.stdout:{} 2024-04-20T02:25:42.939 INFO:teuthology.orchestra.run.smithi171.stderr:filestore_debug_random_read_err = '' (not observed, change may require restart) 2024-04-20T02:25:42.952 DEBUG:teuthology.orchestra.run.smithi171:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0' 2024-04-20T02:25:43.105 INFO:teuthology.orchestra.run.smithi171.stdout:{} 2024-04-20T02:25:43.106 INFO:teuthology.orchestra.run.smithi171.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-04-20T02:25:43.118 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-20T02:25:43.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-20T02:25:43.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:25:45.996 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:25:45.998 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:25:46.009 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-20T02:25:45.864531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1435768,"kb_used_data":841672,"kb_used_omap":9,"kb_used_meta":594038,"kb_avail":564795272,"statfs":{"total":579820584960,"available":578350358528,"internally_reserved":0,"allocated":861872128,"data_stored":13773699714,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":9562,"internal_metadata":608295590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,2,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90145,"num_read_kb":5769280,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":330301440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":315},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002839"},"pg_stats":[{"pgid":"2.f","version":"20'4224","reported_seq":314970,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517218+0000","last_change":"2024-04-20T02:18:35.888475+0000","last_active":"2024-04-20T02:25:36.517218+0000","last_peered":"2024-04-20T02:25:36.517218+0000","last_clean":"2024-04-20T02:25:36.517218+0000","last_became_active":"2024-04-20T02:18:35.888107+0000","last_became_peered":"2024-04-20T02:18:35.888107+0000","last_unstale":"2024-04-20T02:25:36.517218+0000","last_undegraded":"2024-04-20T02:25:36.517218+0000","last_fullsized":"2024-04-20T02:25:36.517218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:09:02.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":310730,"num_read_kb":19886720,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'4608","reported_seq":344063,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519824+0000","last_change":"2024-04-20T02:18:35.884054+0000","last_active":"2024-04-20T02:25:36.519824+0000","last_peered":"2024-04-20T02:25:36.519824+0000","last_clean":"2024-04-20T02:25:36.519824+0000","last_became_active":"2024-04-20T02:18:35.883711+0000","last_became_peered":"2024-04-20T02:18:35.883711+0000","last_unstale":"2024-04-20T02:25:36.519824+0000","last_undegraded":"2024-04-20T02:25:36.519824+0000","last_fullsized":"2024-04-20T02:25:36.519824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":339439,"num_read_kb":21724096,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5],"acting":[4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"20'4513","reported_seq":336286,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518500+0000","last_change":"2024-04-20T02:18:35.888648+0000","last_active":"2024-04-20T02:25:36.518500+0000","last_peered":"2024-04-20T02:25:36.518500+0000","last_clean":"2024-04-20T02:25:36.518500+0000","last_became_active":"2024-04-20T02:18:35.888273+0000","last_became_peered":"2024-04-20T02:18:35.888273+0000","last_unstale":"2024-04-20T02:25:36.518500+0000","last_undegraded":"2024-04-20T02:25:36.518500+0000","last_fullsized":"2024-04-20T02:25:36.518500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:56:38.265196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":331757,"num_read_kb":21232385,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'4544","reported_seq":337876,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519606+0000","last_change":"2024-04-20T02:18:35.882883+0000","last_active":"2024-04-20T02:25:36.519606+0000","last_peered":"2024-04-20T02:25:36.519606+0000","last_clean":"2024-04-20T02:25:36.519606+0000","last_became_active":"2024-04-20T02:18:35.882275+0000","last_became_peered":"2024-04-20T02:18:35.882275+0000","last_unstale":"2024-04-20T02:25:36.519606+0000","last_undegraded":"2024-04-20T02:25:36.519606+0000","last_fullsized":"2024-04-20T02:25:36.519606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":333316,"num_read_kb":21332224,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4176","reported_seq":312326,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.514630+0000","last_change":"2024-04-20T02:18:35.888473+0000","last_active":"2024-04-20T02:25:36.514630+0000","last_peered":"2024-04-20T02:25:36.514630+0000","last_clean":"2024-04-20T02:25:36.514630+0000","last_became_active":"2024-04-20T02:18:35.888108+0000","last_became_peered":"2024-04-20T02:18:35.888108+0000","last_unstale":"2024-04-20T02:25:36.514630+0000","last_undegraded":"2024-04-20T02:25:36.514630+0000","last_fullsized":"2024-04-20T02:25:36.514630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:28:41.210500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":308134,"num_read_kb":19720576,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"20'4896","reported_seq":364823,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517619+0000","last_change":"2024-04-20T02:18:35.885811+0000","last_active":"2024-04-20T02:25:36.517619+0000","last_peered":"2024-04-20T02:25:36.517619+0000","last_clean":"2024-04-20T02:25:36.517619+0000","last_became_active":"2024-04-20T02:18:35.885319+0000","last_became_peered":"2024-04-20T02:18:35.885319+0000","last_unstale":"2024-04-20T02:25:36.517619+0000","last_undegraded":"2024-04-20T02:25:36.517619+0000","last_fullsized":"2024-04-20T02:25:36.517619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320864256,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":359911,"num_read_kb":23034304,"num_write":4896,"num_write_kb":313344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"20'4160","reported_seq":310345,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518887+0000","last_change":"2024-04-20T02:18:35.886262+0000","last_active":"2024-04-20T02:25:36.518887+0000","last_peered":"2024-04-20T02:25:36.518887+0000","last_clean":"2024-04-20T02:25:36.518887+0000","last_became_active":"2024-04-20T02:18:35.885835+0000","last_became_peered":"2024-04-20T02:18:35.885835+0000","last_unstale":"2024-04-20T02:25:36.518887+0000","last_undegraded":"2024-04-20T02:25:36.518887+0000","last_fullsized":"2024-04-20T02:25:36.518887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":306169,"num_read_kb":19594816,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"20'4544","reported_seq":339167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517612+0000","last_change":"2024-04-20T02:18:35.883682+0000","last_active":"2024-04-20T02:25:36.517612+0000","last_peered":"2024-04-20T02:25:36.517612+0000","last_clean":"2024-04-20T02:25:36.517612+0000","last_became_active":"2024-04-20T02:18:35.883256+0000","last_became_peered":"2024-04-20T02:18:35.883256+0000","last_unstale":"2024-04-20T02:25:36.517612+0000","last_undegraded":"2024-04-20T02:25:36.517612+0000","last_fullsized":"2024-04-20T02:25:36.517612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:24:09.020407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":334607,"num_read_kb":21414848,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.869585+0000","last_change":"2024-04-20T02:18:27.862673+0000","last_active":"2024-04-20T02:22:40.869585+0000","last_peered":"2024-04-20T02:22:40.869585+0000","last_clean":"2024-04-20T02:22:40.869585+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:22:40.869585+0000","last_undegraded":"2024-04-20T02:22:40.869585+0000","last_fullsized":"2024-04-20T02:22:40.869585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"20'4480","reported_seq":334202,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517104+0000","last_change":"2024-04-20T02:18:35.886165+0000","last_active":"2024-04-20T02:25:36.517104+0000","last_peered":"2024-04-20T02:25:36.517104+0000","last_clean":"2024-04-20T02:25:36.517104+0000","last_became_active":"2024-04-20T02:18:35.885771+0000","last_became_peered":"2024-04-20T02:18:35.885771+0000","last_unstale":"2024-04-20T02:25:36.517104+0000","last_undegraded":"2024-04-20T02:25:36.517104+0000","last_fullsized":"2024-04-20T02:25:36.517104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":329706,"num_read_kb":21101184,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914739+0000","last_change":"2024-04-20T02:18:27.861031+0000","last_active":"2024-04-20T02:22:40.914739+0000","last_peered":"2024-04-20T02:22:40.914739+0000","last_clean":"2024-04-20T02:22:40.914739+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:22:40.914739+0000","last_undegraded":"2024-04-20T02:22:40.914739+0000","last_fullsized":"2024-04-20T02:22:40.914739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4080","reported_seq":350627,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.523080+0000","last_change":"2024-04-20T02:25:36.523394+0000","last_active":"2024-04-20T02:25:36.523080+0000","last_peered":"2024-04-20T02:25:36.523080+0000","last_clean":"2024-04-20T02:25:36.523080+0000","last_became_active":"2024-04-20T02:18:35.885150+0000","last_became_peered":"2024-04-20T02:18:35.885150+0000","last_unstale":"2024-04-20T02:25:36.523080+0000","last_undegraded":"2024-04-20T02:25:36.523080+0000","last_fullsized":"2024-04-20T02:25:36.523080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:09:43.719561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":300256,"num_read_kb":19216384,"num_write":4080,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6642,"num_bytes_recovered":6964641792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6642},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914552+0000","last_change":"2024-04-20T02:18:27.862623+0000","last_active":"2024-04-20T02:22:40.914552+0000","last_peered":"2024-04-20T02:22:40.914552+0000","last_clean":"2024-04-20T02:22:40.914552+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:22:40.914552+0000","last_undegraded":"2024-04-20T02:22:40.914552+0000","last_fullsized":"2024-04-20T02:22:40.914552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"20'4288","reported_seq":319188,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.515617+0000","last_change":"2024-04-20T02:18:35.883433+0000","last_active":"2024-04-20T02:25:36.515617+0000","last_peered":"2024-04-20T02:25:36.515617+0000","last_clean":"2024-04-20T02:25:36.515617+0000","last_became_active":"2024-04-20T02:18:35.883064+0000","last_became_peered":"2024-04-20T02:18:35.883064+0000","last_unstale":"2024-04-20T02:25:36.515617+0000","last_undegraded":"2024-04-20T02:25:36.515617+0000","last_fullsized":"2024-04-20T02:25:36.515617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:37:47.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":314884,"num_read_kb":20152576,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:38.887734+0000","last_change":"2024-04-20T02:18:27.861334+0000","last_active":"2024-04-20T02:22:38.887734+0000","last_peered":"2024-04-20T02:22:38.887734+0000","last_clean":"2024-04-20T02:22:38.887734+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:22:38.887734+0000","last_undegraded":"2024-04-20T02:22:38.887734+0000","last_fullsized":"2024-04-20T02:22:38.887734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:06:23.060909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4608","reported_seq":343028,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517528+0000","last_change":"2024-04-20T02:18:35.883390+0000","last_active":"2024-04-20T02:25:36.517528+0000","last_peered":"2024-04-20T02:25:36.517528+0000","last_clean":"2024-04-20T02:25:36.517528+0000","last_became_active":"2024-04-20T02:18:35.882708+0000","last_became_peered":"2024-04-20T02:18:35.882708+0000","last_unstale":"2024-04-20T02:25:36.517528+0000","last_undegraded":"2024-04-20T02:25:36.517528+0000","last_fullsized":"2024-04-20T02:25:36.517528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":338404,"num_read_kb":21657856,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:30.937109+0000","last_change":"2024-04-20T02:18:27.863608+0000","last_active":"2024-04-20T02:22:30.937109+0000","last_peered":"2024-04-20T02:22:30.937109+0000","last_clean":"2024-04-20T02:22:30.937109+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:22:30.937109+0000","last_undegraded":"2024-04-20T02:22:30.937109+0000","last_fullsized":"2024-04-20T02:22:30.937109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'4400","reported_seq":376717,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.528375+0000","last_change":"2024-04-20T02:25:36.528654+0000","last_active":"2024-04-20T02:25:36.528375+0000","last_peered":"2024-04-20T02:25:36.528375+0000","last_clean":"2024-04-20T02:25:36.528375+0000","last_became_active":"2024-04-20T02:18:35.882106+0000","last_became_peered":"2024-04-20T02:18:35.882106+0000","last_unstale":"2024-04-20T02:25:36.528375+0000","last_undegraded":"2024-04-20T02:25:36.528375+0000","last_fullsized":"2024-04-20T02:25:36.528375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:32.053379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288358400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":324042,"num_read_kb":20738688,"num_write":4400,"num_write_kb":281600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6933,"num_bytes_recovered":7269777408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6933},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:35.869220+0000","last_change":"2024-04-20T02:18:27.862322+0000","last_active":"2024-04-20T02:22:35.869220+0000","last_peered":"2024-04-20T02:22:35.869220+0000","last_clean":"2024-04-20T02:22:35.869220+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:22:35.869220+0000","last_undegraded":"2024-04-20T02:22:35.869220+0000","last_fullsized":"2024-04-20T02:22:35.869220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'3847","reported_seq":286507,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518808+0000","last_change":"2024-04-20T02:18:35.885452+0000","last_active":"2024-04-20T02:25:36.518808+0000","last_peered":"2024-04-20T02:25:36.518808+0000","last_clean":"2024-04-20T02:25:36.518808+0000","last_became_active":"2024-04-20T02:18:35.885067+0000","last_became_peered":"2024-04-20T02:18:35.885067+0000","last_unstale":"2024-04-20T02:25:36.518808+0000","last_undegraded":"2024-04-20T02:25:36.518808+0000","last_fullsized":"2024-04-20T02:25:36.518808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:54:58.887418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252116992,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":282644,"num_read_kb":18089216,"num_write":3847,"num_write_kb":246208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:45.939311+0000","last_change":"2024-04-20T02:18:27.862246+0000","last_active":"2024-04-20T02:22:45.939311+0000","last_peered":"2024-04-20T02:22:45.939311+0000","last_clean":"2024-04-20T02:22:45.939311+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:22:45.939311+0000","last_undegraded":"2024-04-20T02:22:45.939311+0000","last_fullsized":"2024-04-20T02:22:45.939311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"20'4240","reported_seq":363069,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519140+0000","last_change":"2024-04-20T02:25:36.495758+0000","last_active":"2024-04-20T02:25:36.519140+0000","last_peered":"2024-04-20T02:25:36.519140+0000","last_clean":"2024-04-20T02:25:36.519140+0000","last_became_active":"2024-04-20T02:18:35.882160+0000","last_became_peered":"2024-04-20T02:18:35.882160+0000","last_unstale":"2024-04-20T02:25:36.519140+0000","last_undegraded":"2024-04-20T02:25:36.519140+0000","last_fullsized":"2024-04-20T02:25:36.519140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:00:33.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":311427,"num_read_kb":19931328,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6800,"num_bytes_recovered":7130316800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6800},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:50.940161+0000","last_change":"2024-04-20T02:18:27.863872+0000","last_active":"2024-04-20T02:22:50.940161+0000","last_peered":"2024-04-20T02:22:50.940161+0000","last_clean":"2024-04-20T02:22:50.940161+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:22:50.940161+0000","last_undegraded":"2024-04-20T02:22:50.940161+0000","last_fullsized":"2024-04-20T02:22:50.940161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'4448","reported_seq":332544,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518174+0000","last_change":"2024-04-20T02:18:35.885082+0000","last_active":"2024-04-20T02:25:36.518174+0000","last_peered":"2024-04-20T02:25:36.518174+0000","last_clean":"2024-04-20T02:25:36.518174+0000","last_became_active":"2024-04-20T02:18:35.884739+0000","last_became_peered":"2024-04-20T02:18:35.884739+0000","last_unstale":"2024-04-20T02:25:36.518174+0000","last_undegraded":"2024-04-20T02:25:36.518174+0000","last_fullsized":"2024-04-20T02:25:36.518174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:21:42.919057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":328080,"num_read_kb":20997120,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":860848128,"data_stored":13773373512,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607643,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236108,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94135732,"statfs":{"total":96636764160,"available":96394989568,"internally_reserved":0,"allocated":158732288,"data_stored":2537018675,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.378,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.58399999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.44400000000000001,"15min":0.46200000000000002},"min":{"1min":0.221,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.59699999999999998,"5min":1.0760000000000001,"15min":1.6559999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42199999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.22700000000000001,"15min":0.22500000000000001},"max":{"1min":0.70199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.497},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.62,"5min":0.79600000000000004,"15min":1.6200000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.51800000000000002},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.41199999999999998},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.64300000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.218},"max":{"1min":0.67200000000000004,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.307},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45200000000000001,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.223},"max":{"1min":0.72999999999999998,"5min":0.91700000000000004,"15min":2.4769999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":0.78200000000000003,"5min":1.9470000000000001,"15min":3.3849999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.24299999999999999},"max":{"1min":0.77100000000000002,"5min":1.629,"15min":1.629},"last":0.40600000000000003}]}]},{"osd":3,"up_from":12,"seq":51539607644,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213744,"kb_used_data":128552,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":94158096,"statfs":{"total":96636764160,"available":96417890304,"internally_reserved":0,"allocated":131637248,"data_stored":2103497423,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":1592,"internal_metadata":87226824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36799999999999999,"15min":0.40999999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.94699999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.2929999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42599999999999999,"15min":0.51400000000000001},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.96699999999999997,"5min":1.3220000000000001,"15min":2.4209999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51700000000000002,"15min":0.69299999999999995},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0249999999999999,"5min":2.7410000000000001,"15min":5.3490000000000002},"last":0.498}]},{"osd":4,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.17299999999999999},"max":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.21099999999999999},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.89700000000000002},"last":0.374}]},{"osd":5,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23000000000000001},"max":{"1min":0.66200000000000003,"5min":0.75800000000000001,"15min":2.2469999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.745,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.47399999999999998}]}]},{"osd":2,"up_from":12,"seq":51539607642,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144944,"kb_used_data":87592,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94226896,"statfs":{"total":96636764160,"available":96488341504,"internally_reserved":0,"allocated":89694208,"data_stored":1432409395,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.249},"min":{"1min":0.153,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":1.6830000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.34000000000000002,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.54400000000000004,"5min":1.6379999999999999,"15min":1.726},"last":0.375}]},{"osd":1,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":1.107,"5min":1.6379999999999999,"15min":2.0720000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17499999999999999},"max":{"1min":0.93999999999999995,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.314}]},{"osd":3,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48699999999999999,"15min":0.379},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.20200000000000001},"max":{"1min":1.0409999999999999,"5min":1.569,"15min":1.569},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.39000000000000001},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65100000000000002,"5min":1.657,"15min":1.794},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.76},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.25900000000000001,"15min":0.25800000000000001},"max":{"1min":0.73299999999999998,"5min":1.5449999999999999,"15min":2.8580000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":1.673,"15min":1.8680000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.47599999999999998}]}]},{"osd":1,"up_from":12,"seq":51539607643,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":118088,"kb_used_omap":1,"kb_used_meta":183678,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":120922112,"data_stored":1931990347,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":1594,"internal_metadata":188086726},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,2,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.49099999999999999,"15min":0.32900000000000001},"min":{"1min":0.16600000000000001,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.622,"5min":17.655999999999999,"15min":17.655999999999999},"last":0.216},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.52900000000000003,"15min":0.35999999999999999},"min":{"1min":0.217,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":0.65400000000000003,"5min":17.702000000000002,"15min":17.702000000000002},"last":0.246}]},{"osd":2,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.32200000000000001,"15min":0.32600000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17100000000000001},"max":{"1min":0.57899999999999996,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34399999999999997,"15min":0.33300000000000002},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.61299999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":0.79400000000000004,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":26.936,"5min":26.936,"15min":26.936},"last":0.629},{"interface":"front","average":{"1min":1.9330000000000001,"5min":0.69999999999999996,"15min":0.53800000000000003},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":26.763000000000002,"5min":26.763000000000002,"15min":26.763000000000002},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":3.9390000000000001,"5min":1.1679999999999999,"15min":0.65400000000000003},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":59.158999999999999,"5min":59.158999999999999,"15min":59.158999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":3.8490000000000002,"5min":1.151,"15min":0.67900000000000005},"min":{"1min":0.314,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":58.956000000000003,"5min":58.956000000000003,"15min":58.956000000000003},"last":0.27200000000000002}]},{"osd":5,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.71599999999999997,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":0.61599999999999999,"5min":23.010000000000002,"15min":23.010000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.755,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.29799999999999999,"15min":0.26200000000000001},"max":{"1min":0.64100000000000001,"5min":23.024000000000001,"15min":23.024000000000001},"last":0.29199999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266312,"kb_used_data":172928,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94105528,"statfs":{"total":96636764160,"available":96364060672,"internally_reserved":0,"allocated":177078272,"data_stored":2830619319,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30099999999999999,"15min":0.316},"min":{"1min":0.17000000000000001,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":0.46000000000000002,"5min":0.76300000000000001,"15min":1.526},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.18099999999999999,"5min":0.16400000000000001,"15min":0.14799999999999999},"max":{"1min":0.41499999999999998,"5min":0.81699999999999995,"15min":1.4239999999999999},"last":0.375}]},{"osd":2,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.21199999999999999,"5min":0.182,"15min":0.18099999999999999},"max":{"1min":0.875,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.53400000000000003,"5min":1.27,"15min":1.27},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.69599999999999995,"15min":0.496},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":23.988,"15min":23.988},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.69499999999999995,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.68799999999999994,"5min":24.018999999999998,"15min":24.018999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.24099999999999999},"max":{"1min":0.58999999999999997,"5min":0.96699999999999997,"15min":1.28},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.49399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":1.2529999999999999,"15min":1.5580000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Apr 20 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46800000000000003,"15min":0.63400000000000001},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.76100000000000001,"15min":5.9530000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.93000000000000005,"15min":1.3280000000000001},"last":0.61399999999999999}]}]},{"osd":5,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272884,"kb_used_data":179500,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94098956,"statfs":{"total":96636764160,"available":96357330944,"internally_reserved":0,"allocated":183808000,"data_stored":2938164555,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.434,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.90700000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.8640000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.92900000000000005,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.89100000000000001,"5min":1.649,"15min":1.649},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.105,"5min":1.105,"15min":2.609},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51800000000000002,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":1.8979999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.80200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.19900000000000001},"max":{"1min":0.77300000000000002,"5min":38.515999999999998,"15min":38.515999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.747,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.67600000000000005,"5min":37.109999999999999,"15min":37.109999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":2.2589999999999999},"min":{"1min":0.28000000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.92700000000000005,"5min":0.93200000000000005,"15min":53.170000000000002},"last":0.503},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48899999999999999,"15min":2.2919999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.80600000000000005,"5min":0.91500000000000004,"15min":53.332000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":176910336,"data_stored":2830565376,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":120750080,"data_stored":1931935768,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89522176,"data_stored":1432354816,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131469312,"data_stored":2103443480,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158560256,"data_stored":2536964096,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183635968,"data_stored":2938109976,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:25:46.011 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:25:46.334 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:25:46.337 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:25:46.348 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-20T02:25:45.864531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1435768,"kb_used_data":841672,"kb_used_omap":9,"kb_used_meta":594038,"kb_avail":564795272,"statfs":{"total":579820584960,"available":578350358528,"internally_reserved":0,"allocated":861872128,"data_stored":13773699714,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":9562,"internal_metadata":608295590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,2,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90145,"num_read_kb":5769280,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":330301440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":315},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002839"},"pg_stats":[{"pgid":"2.f","version":"20'4224","reported_seq":314970,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517218+0000","last_change":"2024-04-20T02:18:35.888475+0000","last_active":"2024-04-20T02:25:36.517218+0000","last_peered":"2024-04-20T02:25:36.517218+0000","last_clean":"2024-04-20T02:25:36.517218+0000","last_became_active":"2024-04-20T02:18:35.888107+0000","last_became_peered":"2024-04-20T02:18:35.888107+0000","last_unstale":"2024-04-20T02:25:36.517218+0000","last_undegraded":"2024-04-20T02:25:36.517218+0000","last_fullsized":"2024-04-20T02:25:36.517218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:09:02.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":310730,"num_read_kb":19886720,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'4608","reported_seq":344063,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519824+0000","last_change":"2024-04-20T02:18:35.884054+0000","last_active":"2024-04-20T02:25:36.519824+0000","last_peered":"2024-04-20T02:25:36.519824+0000","last_clean":"2024-04-20T02:25:36.519824+0000","last_became_active":"2024-04-20T02:18:35.883711+0000","last_became_peered":"2024-04-20T02:18:35.883711+0000","last_unstale":"2024-04-20T02:25:36.519824+0000","last_undegraded":"2024-04-20T02:25:36.519824+0000","last_fullsized":"2024-04-20T02:25:36.519824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":339439,"num_read_kb":21724096,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5],"acting":[4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"20'4513","reported_seq":336286,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518500+0000","last_change":"2024-04-20T02:18:35.888648+0000","last_active":"2024-04-20T02:25:36.518500+0000","last_peered":"2024-04-20T02:25:36.518500+0000","last_clean":"2024-04-20T02:25:36.518500+0000","last_became_active":"2024-04-20T02:18:35.888273+0000","last_became_peered":"2024-04-20T02:18:35.888273+0000","last_unstale":"2024-04-20T02:25:36.518500+0000","last_undegraded":"2024-04-20T02:25:36.518500+0000","last_fullsized":"2024-04-20T02:25:36.518500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:56:38.265196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":331757,"num_read_kb":21232385,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'4544","reported_seq":337876,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519606+0000","last_change":"2024-04-20T02:18:35.882883+0000","last_active":"2024-04-20T02:25:36.519606+0000","last_peered":"2024-04-20T02:25:36.519606+0000","last_clean":"2024-04-20T02:25:36.519606+0000","last_became_active":"2024-04-20T02:18:35.882275+0000","last_became_peered":"2024-04-20T02:18:35.882275+0000","last_unstale":"2024-04-20T02:25:36.519606+0000","last_undegraded":"2024-04-20T02:25:36.519606+0000","last_fullsized":"2024-04-20T02:25:36.519606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":333316,"num_read_kb":21332224,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4176","reported_seq":312326,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.514630+0000","last_change":"2024-04-20T02:18:35.888473+0000","last_active":"2024-04-20T02:25:36.514630+0000","last_peered":"2024-04-20T02:25:36.514630+0000","last_clean":"2024-04-20T02:25:36.514630+0000","last_became_active":"2024-04-20T02:18:35.888108+0000","last_became_peered":"2024-04-20T02:18:35.888108+0000","last_unstale":"2024-04-20T02:25:36.514630+0000","last_undegraded":"2024-04-20T02:25:36.514630+0000","last_fullsized":"2024-04-20T02:25:36.514630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:28:41.210500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":308134,"num_read_kb":19720576,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"20'4896","reported_seq":364823,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517619+0000","last_change":"2024-04-20T02:18:35.885811+0000","last_active":"2024-04-20T02:25:36.517619+0000","last_peered":"2024-04-20T02:25:36.517619+0000","last_clean":"2024-04-20T02:25:36.517619+0000","last_became_active":"2024-04-20T02:18:35.885319+0000","last_became_peered":"2024-04-20T02:18:35.885319+0000","last_unstale":"2024-04-20T02:25:36.517619+0000","last_undegraded":"2024-04-20T02:25:36.517619+0000","last_fullsized":"2024-04-20T02:25:36.517619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320864256,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":359911,"num_read_kb":23034304,"num_write":4896,"num_write_kb":313344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"20'4160","reported_seq":310345,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518887+0000","last_change":"2024-04-20T02:18:35.886262+0000","last_active":"2024-04-20T02:25:36.518887+0000","last_peered":"2024-04-20T02:25:36.518887+0000","last_clean":"2024-04-20T02:25:36.518887+0000","last_became_active":"2024-04-20T02:18:35.885835+0000","last_became_peered":"2024-04-20T02:18:35.885835+0000","last_unstale":"2024-04-20T02:25:36.518887+0000","last_undegraded":"2024-04-20T02:25:36.518887+0000","last_fullsized":"2024-04-20T02:25:36.518887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":306169,"num_read_kb":19594816,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"20'4544","reported_seq":339167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517612+0000","last_change":"2024-04-20T02:18:35.883682+0000","last_active":"2024-04-20T02:25:36.517612+0000","last_peered":"2024-04-20T02:25:36.517612+0000","last_clean":"2024-04-20T02:25:36.517612+0000","last_became_active":"2024-04-20T02:18:35.883256+0000","last_became_peered":"2024-04-20T02:18:35.883256+0000","last_unstale":"2024-04-20T02:25:36.517612+0000","last_undegraded":"2024-04-20T02:25:36.517612+0000","last_fullsized":"2024-04-20T02:25:36.517612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:24:09.020407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":334607,"num_read_kb":21414848,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.869585+0000","last_change":"2024-04-20T02:18:27.862673+0000","last_active":"2024-04-20T02:22:40.869585+0000","last_peered":"2024-04-20T02:22:40.869585+0000","last_clean":"2024-04-20T02:22:40.869585+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:22:40.869585+0000","last_undegraded":"2024-04-20T02:22:40.869585+0000","last_fullsized":"2024-04-20T02:22:40.869585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"20'4480","reported_seq":334202,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517104+0000","last_change":"2024-04-20T02:18:35.886165+0000","last_active":"2024-04-20T02:25:36.517104+0000","last_peered":"2024-04-20T02:25:36.517104+0000","last_clean":"2024-04-20T02:25:36.517104+0000","last_became_active":"2024-04-20T02:18:35.885771+0000","last_became_peered":"2024-04-20T02:18:35.885771+0000","last_unstale":"2024-04-20T02:25:36.517104+0000","last_undegraded":"2024-04-20T02:25:36.517104+0000","last_fullsized":"2024-04-20T02:25:36.517104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":329706,"num_read_kb":21101184,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914739+0000","last_change":"2024-04-20T02:18:27.861031+0000","last_active":"2024-04-20T02:22:40.914739+0000","last_peered":"2024-04-20T02:22:40.914739+0000","last_clean":"2024-04-20T02:22:40.914739+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:22:40.914739+0000","last_undegraded":"2024-04-20T02:22:40.914739+0000","last_fullsized":"2024-04-20T02:22:40.914739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4080","reported_seq":350627,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.523080+0000","last_change":"2024-04-20T02:25:36.523394+0000","last_active":"2024-04-20T02:25:36.523080+0000","last_peered":"2024-04-20T02:25:36.523080+0000","last_clean":"2024-04-20T02:25:36.523080+0000","last_became_active":"2024-04-20T02:18:35.885150+0000","last_became_peered":"2024-04-20T02:18:35.885150+0000","last_unstale":"2024-04-20T02:25:36.523080+0000","last_undegraded":"2024-04-20T02:25:36.523080+0000","last_fullsized":"2024-04-20T02:25:36.523080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:09:43.719561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":300256,"num_read_kb":19216384,"num_write":4080,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6642,"num_bytes_recovered":6964641792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6642},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914552+0000","last_change":"2024-04-20T02:18:27.862623+0000","last_active":"2024-04-20T02:22:40.914552+0000","last_peered":"2024-04-20T02:22:40.914552+0000","last_clean":"2024-04-20T02:22:40.914552+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:22:40.914552+0000","last_undegraded":"2024-04-20T02:22:40.914552+0000","last_fullsized":"2024-04-20T02:22:40.914552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"20'4288","reported_seq":319188,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.515617+0000","last_change":"2024-04-20T02:18:35.883433+0000","last_active":"2024-04-20T02:25:36.515617+0000","last_peered":"2024-04-20T02:25:36.515617+0000","last_clean":"2024-04-20T02:25:36.515617+0000","last_became_active":"2024-04-20T02:18:35.883064+0000","last_became_peered":"2024-04-20T02:18:35.883064+0000","last_unstale":"2024-04-20T02:25:36.515617+0000","last_undegraded":"2024-04-20T02:25:36.515617+0000","last_fullsized":"2024-04-20T02:25:36.515617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:37:47.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":314884,"num_read_kb":20152576,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:38.887734+0000","last_change":"2024-04-20T02:18:27.861334+0000","last_active":"2024-04-20T02:22:38.887734+0000","last_peered":"2024-04-20T02:22:38.887734+0000","last_clean":"2024-04-20T02:22:38.887734+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:22:38.887734+0000","last_undegraded":"2024-04-20T02:22:38.887734+0000","last_fullsized":"2024-04-20T02:22:38.887734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:06:23.060909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4608","reported_seq":343028,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517528+0000","last_change":"2024-04-20T02:18:35.883390+0000","last_active":"2024-04-20T02:25:36.517528+0000","last_peered":"2024-04-20T02:25:36.517528+0000","last_clean":"2024-04-20T02:25:36.517528+0000","last_became_active":"2024-04-20T02:18:35.882708+0000","last_became_peered":"2024-04-20T02:18:35.882708+0000","last_unstale":"2024-04-20T02:25:36.517528+0000","last_undegraded":"2024-04-20T02:25:36.517528+0000","last_fullsized":"2024-04-20T02:25:36.517528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":338404,"num_read_kb":21657856,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:30.937109+0000","last_change":"2024-04-20T02:18:27.863608+0000","last_active":"2024-04-20T02:22:30.937109+0000","last_peered":"2024-04-20T02:22:30.937109+0000","last_clean":"2024-04-20T02:22:30.937109+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:22:30.937109+0000","last_undegraded":"2024-04-20T02:22:30.937109+0000","last_fullsized":"2024-04-20T02:22:30.937109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'4400","reported_seq":376717,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.528375+0000","last_change":"2024-04-20T02:25:36.528654+0000","last_active":"2024-04-20T02:25:36.528375+0000","last_peered":"2024-04-20T02:25:36.528375+0000","last_clean":"2024-04-20T02:25:36.528375+0000","last_became_active":"2024-04-20T02:18:35.882106+0000","last_became_peered":"2024-04-20T02:18:35.882106+0000","last_unstale":"2024-04-20T02:25:36.528375+0000","last_undegraded":"2024-04-20T02:25:36.528375+0000","last_fullsized":"2024-04-20T02:25:36.528375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:32.053379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288358400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":324042,"num_read_kb":20738688,"num_write":4400,"num_write_kb":281600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6933,"num_bytes_recovered":7269777408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6933},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:35.869220+0000","last_change":"2024-04-20T02:18:27.862322+0000","last_active":"2024-04-20T02:22:35.869220+0000","last_peered":"2024-04-20T02:22:35.869220+0000","last_clean":"2024-04-20T02:22:35.869220+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:22:35.869220+0000","last_undegraded":"2024-04-20T02:22:35.869220+0000","last_fullsized":"2024-04-20T02:22:35.869220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'3847","reported_seq":286507,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518808+0000","last_change":"2024-04-20T02:18:35.885452+0000","last_active":"2024-04-20T02:25:36.518808+0000","last_peered":"2024-04-20T02:25:36.518808+0000","last_clean":"2024-04-20T02:25:36.518808+0000","last_became_active":"2024-04-20T02:18:35.885067+0000","last_became_peered":"2024-04-20T02:18:35.885067+0000","last_unstale":"2024-04-20T02:25:36.518808+0000","last_undegraded":"2024-04-20T02:25:36.518808+0000","last_fullsized":"2024-04-20T02:25:36.518808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:54:58.887418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252116992,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":282644,"num_read_kb":18089216,"num_write":3847,"num_write_kb":246208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:45.939311+0000","last_change":"2024-04-20T02:18:27.862246+0000","last_active":"2024-04-20T02:22:45.939311+0000","last_peered":"2024-04-20T02:22:45.939311+0000","last_clean":"2024-04-20T02:22:45.939311+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:22:45.939311+0000","last_undegraded":"2024-04-20T02:22:45.939311+0000","last_fullsized":"2024-04-20T02:22:45.939311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"20'4240","reported_seq":363069,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519140+0000","last_change":"2024-04-20T02:25:36.495758+0000","last_active":"2024-04-20T02:25:36.519140+0000","last_peered":"2024-04-20T02:25:36.519140+0000","last_clean":"2024-04-20T02:25:36.519140+0000","last_became_active":"2024-04-20T02:18:35.882160+0000","last_became_peered":"2024-04-20T02:18:35.882160+0000","last_unstale":"2024-04-20T02:25:36.519140+0000","last_undegraded":"2024-04-20T02:25:36.519140+0000","last_fullsized":"2024-04-20T02:25:36.519140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:00:33.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":311427,"num_read_kb":19931328,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6800,"num_bytes_recovered":7130316800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6800},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:50.940161+0000","last_change":"2024-04-20T02:18:27.863872+0000","last_active":"2024-04-20T02:22:50.940161+0000","last_peered":"2024-04-20T02:22:50.940161+0000","last_clean":"2024-04-20T02:22:50.940161+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:22:50.940161+0000","last_undegraded":"2024-04-20T02:22:50.940161+0000","last_fullsized":"2024-04-20T02:22:50.940161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'4448","reported_seq":332544,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518174+0000","last_change":"2024-04-20T02:18:35.885082+0000","last_active":"2024-04-20T02:25:36.518174+0000","last_peered":"2024-04-20T02:25:36.518174+0000","last_clean":"2024-04-20T02:25:36.518174+0000","last_became_active":"2024-04-20T02:18:35.884739+0000","last_became_peered":"2024-04-20T02:18:35.884739+0000","last_unstale":"2024-04-20T02:25:36.518174+0000","last_undegraded":"2024-04-20T02:25:36.518174+0000","last_fullsized":"2024-04-20T02:25:36.518174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:21:42.919057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":328080,"num_read_kb":20997120,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":860848128,"data_stored":13773373512,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607643,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236108,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94135732,"statfs":{"total":96636764160,"available":96394989568,"internally_reserved":0,"allocated":158732288,"data_stored":2537018675,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.378,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.58399999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.44400000000000001,"15min":0.46200000000000002},"min":{"1min":0.221,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.59699999999999998,"5min":1.0760000000000001,"15min":1.6559999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42199999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.22700000000000001,"15min":0.22500000000000001},"max":{"1min":0.70199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.497},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.62,"5min":0.79600000000000004,"15min":1.6200000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.51800000000000002},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.41199999999999998},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.64300000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.218},"max":{"1min":0.67200000000000004,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.307},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45200000000000001,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.223},"max":{"1min":0.72999999999999998,"5min":0.91700000000000004,"15min":2.4769999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":0.78200000000000003,"5min":1.9470000000000001,"15min":3.3849999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.24299999999999999},"max":{"1min":0.77100000000000002,"5min":1.629,"15min":1.629},"last":0.40600000000000003}]}]},{"osd":3,"up_from":12,"seq":51539607644,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213744,"kb_used_data":128552,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":94158096,"statfs":{"total":96636764160,"available":96417890304,"internally_reserved":0,"allocated":131637248,"data_stored":2103497423,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":1592,"internal_metadata":87226824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36799999999999999,"15min":0.40999999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.94699999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.2929999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42599999999999999,"15min":0.51400000000000001},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.96699999999999997,"5min":1.3220000000000001,"15min":2.4209999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51700000000000002,"15min":0.69299999999999995},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0249999999999999,"5min":2.7410000000000001,"15min":5.3490000000000002},"last":0.498}]},{"osd":4,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.17299999999999999},"max":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.21099999999999999},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.89700000000000002},"last":0.374}]},{"osd":5,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23000000000000001},"max":{"1min":0.66200000000000003,"5min":0.75800000000000001,"15min":2.2469999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.745,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.47399999999999998}]}]},{"osd":2,"up_from":12,"seq":51539607642,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144944,"kb_used_data":87592,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94226896,"statfs":{"total":96636764160,"available":96488341504,"internally_reserved":0,"allocated":89694208,"data_stored":1432409395,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.249},"min":{"1min":0.153,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":1.6830000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.34000000000000002,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.54400000000000004,"5min":1.6379999999999999,"15min":1.726},"last":0.375}]},{"osd":1,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":1.107,"5min":1.6379999999999999,"15min":2.0720000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17499999999999999},"max":{"1min":0.93999999999999995,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.314}]},{"osd":3,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48699999999999999,"15min":0.379},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.20200000000000001},"max":{"1min":1.0409999999999999,"5min":1.569,"15min":1.569},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.39000000000000001},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65100000000000002,"5min":1.657,"15min":1.794},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.76},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.25900000000000001,"15min":0.25800000000000001},"max":{"1min":0.73299999999999998,"5min":1.5449999999999999,"15min":2.8580000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":1.673,"15min":1.8680000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.47599999999999998}]}]},{"osd":1,"up_from":12,"seq":51539607643,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":118088,"kb_used_omap":1,"kb_used_meta":183678,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":120922112,"data_stored":1931990347,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":1594,"internal_metadata":188086726},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,2,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.49099999999999999,"15min":0.32900000000000001},"min":{"1min":0.16600000000000001,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.622,"5min":17.655999999999999,"15min":17.655999999999999},"last":0.216},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.52900000000000003,"15min":0.35999999999999999},"min":{"1min":0.217,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":0.65400000000000003,"5min":17.702000000000002,"15min":17.702000000000002},"last":0.246}]},{"osd":2,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.32200000000000001,"15min":0.32600000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17100000000000001},"max":{"1min":0.57899999999999996,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34399999999999997,"15min":0.33300000000000002},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.61299999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":0.79400000000000004,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":26.936,"5min":26.936,"15min":26.936},"last":0.629},{"interface":"front","average":{"1min":1.9330000000000001,"5min":0.69999999999999996,"15min":0.53800000000000003},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":26.763000000000002,"5min":26.763000000000002,"15min":26.763000000000002},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":3.9390000000000001,"5min":1.1679999999999999,"15min":0.65400000000000003},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":59.158999999999999,"5min":59.158999999999999,"15min":59.158999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":3.8490000000000002,"5min":1.151,"15min":0.67900000000000005},"min":{"1min":0.314,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":58.956000000000003,"5min":58.956000000000003,"15min":58.956000000000003},"last":0.27200000000000002}]},{"osd":5,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.71599999999999997,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":0.61599999999999999,"5min":23.010000000000002,"15min":23.010000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.755,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.29799999999999999,"15min":0.26200000000000001},"max":{"1min":0.64100000000000001,"5min":23.024000000000001,"15min":23.024000000000001},"last":0.29199999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266312,"kb_used_data":172928,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94105528,"statfs":{"total":96636764160,"available":96364060672,"internally_reserved":0,"allocated":177078272,"data_stored":2830619319,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30099999999999999,"15min":0.316},"min":{"1min":0.17000000000000001,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":0.46000000000000002,"5min":0.76300000000000001,"15min":1.526},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.18099999999999999,"5min":0.16400000000000001,"15min":0.14799999999999999},"max":{"1min":0.41499999999999998,"5min":0.81699999999999995,"15min":1.4239999999999999},"last":0.375}]},{"osd":2,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.21199999999999999,"5min":0.182,"15min":0.18099999999999999},"max":{"1min":0.875,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.53400000000000003,"5min":1.27,"15min":1.27},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.69599999999999995,"15min":0.496},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":23.988,"15min":23.988},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.69499999999999995,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.68799999999999994,"5min":24.018999999999998,"15min":24.018999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.24099999999999999},"max":{"1min":0.58999999999999997,"5min":0.96699999999999997,"15min":1.28},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.49399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":1.2529999999999999,"15min":1.5580000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Apr 20 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46800000000000003,"15min":0.63400000000000001},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.76100000000000001,"15min":5.9530000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.93000000000000005,"15min":1.3280000000000001},"last":0.61399999999999999}]}]},{"osd":5,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272884,"kb_used_data":179500,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94098956,"statfs":{"total":96636764160,"available":96357330944,"internally_reserved":0,"allocated":183808000,"data_stored":2938164555,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.434,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.90700000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.8640000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.92900000000000005,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.89100000000000001,"5min":1.649,"15min":1.649},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.105,"5min":1.105,"15min":2.609},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51800000000000002,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":1.8979999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.80200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.19900000000000001},"max":{"1min":0.77300000000000002,"5min":38.515999999999998,"15min":38.515999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.747,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.67600000000000005,"5min":37.109999999999999,"15min":37.109999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":2.2589999999999999},"min":{"1min":0.28000000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.92700000000000005,"5min":0.93200000000000005,"15min":53.170000000000002},"last":0.503},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48899999999999999,"15min":2.2919999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.80600000000000005,"5min":0.91500000000000004,"15min":53.332000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":176910336,"data_stored":2830565376,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":120750080,"data_stored":1931935768,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89522176,"data_stored":1432354816,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131469312,"data_stored":2103443480,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158560256,"data_stored":2536964096,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183635968,"data_stored":2938109976,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:25:46.349 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-20T02:25:46.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:25:46.674 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:25:46.675 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:25:46.685 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-20T02:25:45.864531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1435768,"kb_used_data":841672,"kb_used_omap":9,"kb_used_meta":594038,"kb_avail":564795272,"statfs":{"total":579820584960,"available":578350358528,"internally_reserved":0,"allocated":861872128,"data_stored":13773699714,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":9562,"internal_metadata":608295590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,2,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90145,"num_read_kb":5769280,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":330301440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":315},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002839"},"pg_stats":[{"pgid":"2.f","version":"20'4224","reported_seq":314970,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517218+0000","last_change":"2024-04-20T02:18:35.888475+0000","last_active":"2024-04-20T02:25:36.517218+0000","last_peered":"2024-04-20T02:25:36.517218+0000","last_clean":"2024-04-20T02:25:36.517218+0000","last_became_active":"2024-04-20T02:18:35.888107+0000","last_became_peered":"2024-04-20T02:18:35.888107+0000","last_unstale":"2024-04-20T02:25:36.517218+0000","last_undegraded":"2024-04-20T02:25:36.517218+0000","last_fullsized":"2024-04-20T02:25:36.517218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:09:02.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":310730,"num_read_kb":19886720,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'4608","reported_seq":344063,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519824+0000","last_change":"2024-04-20T02:18:35.884054+0000","last_active":"2024-04-20T02:25:36.519824+0000","last_peered":"2024-04-20T02:25:36.519824+0000","last_clean":"2024-04-20T02:25:36.519824+0000","last_became_active":"2024-04-20T02:18:35.883711+0000","last_became_peered":"2024-04-20T02:18:35.883711+0000","last_unstale":"2024-04-20T02:25:36.519824+0000","last_undegraded":"2024-04-20T02:25:36.519824+0000","last_fullsized":"2024-04-20T02:25:36.519824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":339439,"num_read_kb":21724096,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5],"acting":[4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"20'4513","reported_seq":336286,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518500+0000","last_change":"2024-04-20T02:18:35.888648+0000","last_active":"2024-04-20T02:25:36.518500+0000","last_peered":"2024-04-20T02:25:36.518500+0000","last_clean":"2024-04-20T02:25:36.518500+0000","last_became_active":"2024-04-20T02:18:35.888273+0000","last_became_peered":"2024-04-20T02:18:35.888273+0000","last_unstale":"2024-04-20T02:25:36.518500+0000","last_undegraded":"2024-04-20T02:25:36.518500+0000","last_fullsized":"2024-04-20T02:25:36.518500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:56:38.265196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":331757,"num_read_kb":21232385,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'4544","reported_seq":337876,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519606+0000","last_change":"2024-04-20T02:18:35.882883+0000","last_active":"2024-04-20T02:25:36.519606+0000","last_peered":"2024-04-20T02:25:36.519606+0000","last_clean":"2024-04-20T02:25:36.519606+0000","last_became_active":"2024-04-20T02:18:35.882275+0000","last_became_peered":"2024-04-20T02:18:35.882275+0000","last_unstale":"2024-04-20T02:25:36.519606+0000","last_undegraded":"2024-04-20T02:25:36.519606+0000","last_fullsized":"2024-04-20T02:25:36.519606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":333316,"num_read_kb":21332224,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4176","reported_seq":312326,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.514630+0000","last_change":"2024-04-20T02:18:35.888473+0000","last_active":"2024-04-20T02:25:36.514630+0000","last_peered":"2024-04-20T02:25:36.514630+0000","last_clean":"2024-04-20T02:25:36.514630+0000","last_became_active":"2024-04-20T02:18:35.888108+0000","last_became_peered":"2024-04-20T02:18:35.888108+0000","last_unstale":"2024-04-20T02:25:36.514630+0000","last_undegraded":"2024-04-20T02:25:36.514630+0000","last_fullsized":"2024-04-20T02:25:36.514630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:28:41.210500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":308134,"num_read_kb":19720576,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"20'4896","reported_seq":364823,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517619+0000","last_change":"2024-04-20T02:18:35.885811+0000","last_active":"2024-04-20T02:25:36.517619+0000","last_peered":"2024-04-20T02:25:36.517619+0000","last_clean":"2024-04-20T02:25:36.517619+0000","last_became_active":"2024-04-20T02:18:35.885319+0000","last_became_peered":"2024-04-20T02:18:35.885319+0000","last_unstale":"2024-04-20T02:25:36.517619+0000","last_undegraded":"2024-04-20T02:25:36.517619+0000","last_fullsized":"2024-04-20T02:25:36.517619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320864256,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":359911,"num_read_kb":23034304,"num_write":4896,"num_write_kb":313344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"20'4160","reported_seq":310345,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518887+0000","last_change":"2024-04-20T02:18:35.886262+0000","last_active":"2024-04-20T02:25:36.518887+0000","last_peered":"2024-04-20T02:25:36.518887+0000","last_clean":"2024-04-20T02:25:36.518887+0000","last_became_active":"2024-04-20T02:18:35.885835+0000","last_became_peered":"2024-04-20T02:18:35.885835+0000","last_unstale":"2024-04-20T02:25:36.518887+0000","last_undegraded":"2024-04-20T02:25:36.518887+0000","last_fullsized":"2024-04-20T02:25:36.518887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":306169,"num_read_kb":19594816,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"20'4544","reported_seq":339167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517612+0000","last_change":"2024-04-20T02:18:35.883682+0000","last_active":"2024-04-20T02:25:36.517612+0000","last_peered":"2024-04-20T02:25:36.517612+0000","last_clean":"2024-04-20T02:25:36.517612+0000","last_became_active":"2024-04-20T02:18:35.883256+0000","last_became_peered":"2024-04-20T02:18:35.883256+0000","last_unstale":"2024-04-20T02:25:36.517612+0000","last_undegraded":"2024-04-20T02:25:36.517612+0000","last_fullsized":"2024-04-20T02:25:36.517612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:24:09.020407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":334607,"num_read_kb":21414848,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.869585+0000","last_change":"2024-04-20T02:18:27.862673+0000","last_active":"2024-04-20T02:22:40.869585+0000","last_peered":"2024-04-20T02:22:40.869585+0000","last_clean":"2024-04-20T02:22:40.869585+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:22:40.869585+0000","last_undegraded":"2024-04-20T02:22:40.869585+0000","last_fullsized":"2024-04-20T02:22:40.869585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"20'4480","reported_seq":334202,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517104+0000","last_change":"2024-04-20T02:18:35.886165+0000","last_active":"2024-04-20T02:25:36.517104+0000","last_peered":"2024-04-20T02:25:36.517104+0000","last_clean":"2024-04-20T02:25:36.517104+0000","last_became_active":"2024-04-20T02:18:35.885771+0000","last_became_peered":"2024-04-20T02:18:35.885771+0000","last_unstale":"2024-04-20T02:25:36.517104+0000","last_undegraded":"2024-04-20T02:25:36.517104+0000","last_fullsized":"2024-04-20T02:25:36.517104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":329706,"num_read_kb":21101184,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914739+0000","last_change":"2024-04-20T02:18:27.861031+0000","last_active":"2024-04-20T02:22:40.914739+0000","last_peered":"2024-04-20T02:22:40.914739+0000","last_clean":"2024-04-20T02:22:40.914739+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:22:40.914739+0000","last_undegraded":"2024-04-20T02:22:40.914739+0000","last_fullsized":"2024-04-20T02:22:40.914739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4080","reported_seq":350627,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.523080+0000","last_change":"2024-04-20T02:25:36.523394+0000","last_active":"2024-04-20T02:25:36.523080+0000","last_peered":"2024-04-20T02:25:36.523080+0000","last_clean":"2024-04-20T02:25:36.523080+0000","last_became_active":"2024-04-20T02:18:35.885150+0000","last_became_peered":"2024-04-20T02:18:35.885150+0000","last_unstale":"2024-04-20T02:25:36.523080+0000","last_undegraded":"2024-04-20T02:25:36.523080+0000","last_fullsized":"2024-04-20T02:25:36.523080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:09:43.719561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":300256,"num_read_kb":19216384,"num_write":4080,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6642,"num_bytes_recovered":6964641792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6642},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914552+0000","last_change":"2024-04-20T02:18:27.862623+0000","last_active":"2024-04-20T02:22:40.914552+0000","last_peered":"2024-04-20T02:22:40.914552+0000","last_clean":"2024-04-20T02:22:40.914552+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:22:40.914552+0000","last_undegraded":"2024-04-20T02:22:40.914552+0000","last_fullsized":"2024-04-20T02:22:40.914552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"20'4288","reported_seq":319188,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.515617+0000","last_change":"2024-04-20T02:18:35.883433+0000","last_active":"2024-04-20T02:25:36.515617+0000","last_peered":"2024-04-20T02:25:36.515617+0000","last_clean":"2024-04-20T02:25:36.515617+0000","last_became_active":"2024-04-20T02:18:35.883064+0000","last_became_peered":"2024-04-20T02:18:35.883064+0000","last_unstale":"2024-04-20T02:25:36.515617+0000","last_undegraded":"2024-04-20T02:25:36.515617+0000","last_fullsized":"2024-04-20T02:25:36.515617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:37:47.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":314884,"num_read_kb":20152576,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:38.887734+0000","last_change":"2024-04-20T02:18:27.861334+0000","last_active":"2024-04-20T02:22:38.887734+0000","last_peered":"2024-04-20T02:22:38.887734+0000","last_clean":"2024-04-20T02:22:38.887734+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:22:38.887734+0000","last_undegraded":"2024-04-20T02:22:38.887734+0000","last_fullsized":"2024-04-20T02:22:38.887734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:06:23.060909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4608","reported_seq":343028,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517528+0000","last_change":"2024-04-20T02:18:35.883390+0000","last_active":"2024-04-20T02:25:36.517528+0000","last_peered":"2024-04-20T02:25:36.517528+0000","last_clean":"2024-04-20T02:25:36.517528+0000","last_became_active":"2024-04-20T02:18:35.882708+0000","last_became_peered":"2024-04-20T02:18:35.882708+0000","last_unstale":"2024-04-20T02:25:36.517528+0000","last_undegraded":"2024-04-20T02:25:36.517528+0000","last_fullsized":"2024-04-20T02:25:36.517528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":338404,"num_read_kb":21657856,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:30.937109+0000","last_change":"2024-04-20T02:18:27.863608+0000","last_active":"2024-04-20T02:22:30.937109+0000","last_peered":"2024-04-20T02:22:30.937109+0000","last_clean":"2024-04-20T02:22:30.937109+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:22:30.937109+0000","last_undegraded":"2024-04-20T02:22:30.937109+0000","last_fullsized":"2024-04-20T02:22:30.937109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'4400","reported_seq":376717,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.528375+0000","last_change":"2024-04-20T02:25:36.528654+0000","last_active":"2024-04-20T02:25:36.528375+0000","last_peered":"2024-04-20T02:25:36.528375+0000","last_clean":"2024-04-20T02:25:36.528375+0000","last_became_active":"2024-04-20T02:18:35.882106+0000","last_became_peered":"2024-04-20T02:18:35.882106+0000","last_unstale":"2024-04-20T02:25:36.528375+0000","last_undegraded":"2024-04-20T02:25:36.528375+0000","last_fullsized":"2024-04-20T02:25:36.528375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:32.053379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288358400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":324042,"num_read_kb":20738688,"num_write":4400,"num_write_kb":281600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6933,"num_bytes_recovered":7269777408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6933},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:35.869220+0000","last_change":"2024-04-20T02:18:27.862322+0000","last_active":"2024-04-20T02:22:35.869220+0000","last_peered":"2024-04-20T02:22:35.869220+0000","last_clean":"2024-04-20T02:22:35.869220+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:22:35.869220+0000","last_undegraded":"2024-04-20T02:22:35.869220+0000","last_fullsized":"2024-04-20T02:22:35.869220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'3847","reported_seq":286507,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518808+0000","last_change":"2024-04-20T02:18:35.885452+0000","last_active":"2024-04-20T02:25:36.518808+0000","last_peered":"2024-04-20T02:25:36.518808+0000","last_clean":"2024-04-20T02:25:36.518808+0000","last_became_active":"2024-04-20T02:18:35.885067+0000","last_became_peered":"2024-04-20T02:18:35.885067+0000","last_unstale":"2024-04-20T02:25:36.518808+0000","last_undegraded":"2024-04-20T02:25:36.518808+0000","last_fullsized":"2024-04-20T02:25:36.518808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:54:58.887418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252116992,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":282644,"num_read_kb":18089216,"num_write":3847,"num_write_kb":246208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:45.939311+0000","last_change":"2024-04-20T02:18:27.862246+0000","last_active":"2024-04-20T02:22:45.939311+0000","last_peered":"2024-04-20T02:22:45.939311+0000","last_clean":"2024-04-20T02:22:45.939311+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:22:45.939311+0000","last_undegraded":"2024-04-20T02:22:45.939311+0000","last_fullsized":"2024-04-20T02:22:45.939311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"20'4240","reported_seq":363069,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519140+0000","last_change":"2024-04-20T02:25:36.495758+0000","last_active":"2024-04-20T02:25:36.519140+0000","last_peered":"2024-04-20T02:25:36.519140+0000","last_clean":"2024-04-20T02:25:36.519140+0000","last_became_active":"2024-04-20T02:18:35.882160+0000","last_became_peered":"2024-04-20T02:18:35.882160+0000","last_unstale":"2024-04-20T02:25:36.519140+0000","last_undegraded":"2024-04-20T02:25:36.519140+0000","last_fullsized":"2024-04-20T02:25:36.519140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:00:33.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":311427,"num_read_kb":19931328,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6800,"num_bytes_recovered":7130316800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6800},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:50.940161+0000","last_change":"2024-04-20T02:18:27.863872+0000","last_active":"2024-04-20T02:22:50.940161+0000","last_peered":"2024-04-20T02:22:50.940161+0000","last_clean":"2024-04-20T02:22:50.940161+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:22:50.940161+0000","last_undegraded":"2024-04-20T02:22:50.940161+0000","last_fullsized":"2024-04-20T02:22:50.940161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'4448","reported_seq":332544,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518174+0000","last_change":"2024-04-20T02:18:35.885082+0000","last_active":"2024-04-20T02:25:36.518174+0000","last_peered":"2024-04-20T02:25:36.518174+0000","last_clean":"2024-04-20T02:25:36.518174+0000","last_became_active":"2024-04-20T02:18:35.884739+0000","last_became_peered":"2024-04-20T02:18:35.884739+0000","last_unstale":"2024-04-20T02:25:36.518174+0000","last_undegraded":"2024-04-20T02:25:36.518174+0000","last_fullsized":"2024-04-20T02:25:36.518174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:21:42.919057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":328080,"num_read_kb":20997120,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":860848128,"data_stored":13773373512,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607643,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236108,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94135732,"statfs":{"total":96636764160,"available":96394989568,"internally_reserved":0,"allocated":158732288,"data_stored":2537018675,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.378,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.58399999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.44400000000000001,"15min":0.46200000000000002},"min":{"1min":0.221,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.59699999999999998,"5min":1.0760000000000001,"15min":1.6559999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.42199999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.22700000000000001,"15min":0.22500000000000001},"max":{"1min":0.70199999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.497},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":0.62,"5min":0.79600000000000004,"15min":1.6200000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47699999999999998,"15min":0.51800000000000002},"min":{"1min":0.28799999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.41199999999999998},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.64300000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.218},"max":{"1min":0.67200000000000004,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.307},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45200000000000001,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.253,"15min":0.223},"max":{"1min":0.72999999999999998,"5min":0.91700000000000004,"15min":2.4769999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Apr 20 02:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":0.78200000000000003,"5min":1.9470000000000001,"15min":3.3849999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.50800000000000001,"15min":0.45400000000000001},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.24299999999999999},"max":{"1min":0.77100000000000002,"5min":1.629,"15min":1.629},"last":0.40600000000000003}]}]},{"osd":3,"up_from":12,"seq":51539607644,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213744,"kb_used_data":128552,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":94158096,"statfs":{"total":96636764160,"available":96417890304,"internally_reserved":0,"allocated":131637248,"data_stored":2103497423,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":1592,"internal_metadata":87226824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36799999999999999,"15min":0.40999999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.94699999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.2929999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42599999999999999,"15min":0.51400000000000001},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.96699999999999997,"5min":1.3220000000000001,"15min":2.4209999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51700000000000002,"15min":0.69299999999999995},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0249999999999999,"5min":2.7410000000000001,"15min":5.3490000000000002},"last":0.498}]},{"osd":4,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.17299999999999999},"max":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.21099999999999999},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.89700000000000002},"last":0.374}]},{"osd":5,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23000000000000001},"max":{"1min":0.66200000000000003,"5min":0.75800000000000001,"15min":2.2469999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.745,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.47399999999999998}]}]},{"osd":2,"up_from":12,"seq":51539607642,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144944,"kb_used_data":87592,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94226896,"statfs":{"total":96636764160,"available":96488341504,"internally_reserved":0,"allocated":89694208,"data_stored":1432409395,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.249},"min":{"1min":0.153,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":1.6830000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.34000000000000002,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.54400000000000004,"5min":1.6379999999999999,"15min":1.726},"last":0.375}]},{"osd":1,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":1.107,"5min":1.6379999999999999,"15min":2.0720000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17499999999999999},"max":{"1min":0.93999999999999995,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.314}]},{"osd":3,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48699999999999999,"15min":0.379},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.20200000000000001},"max":{"1min":1.0409999999999999,"5min":1.569,"15min":1.569},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.39000000000000001},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65100000000000002,"5min":1.657,"15min":1.794},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.76},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.25900000000000001,"15min":0.25800000000000001},"max":{"1min":0.73299999999999998,"5min":1.5449999999999999,"15min":2.8580000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":1.673,"15min":1.8680000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.47599999999999998}]}]},{"osd":1,"up_from":12,"seq":51539607643,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":118088,"kb_used_omap":1,"kb_used_meta":183678,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":120922112,"data_stored":1931990347,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":1594,"internal_metadata":188086726},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,2,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.49099999999999999,"15min":0.32900000000000001},"min":{"1min":0.16600000000000001,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":0.622,"5min":17.655999999999999,"15min":17.655999999999999},"last":0.216},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.52900000000000003,"15min":0.35999999999999999},"min":{"1min":0.217,"5min":0.17799999999999999,"15min":0.153},"max":{"1min":0.65400000000000003,"5min":17.702000000000002,"15min":17.702000000000002},"last":0.246}]},{"osd":2,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.26700000000000002,"5min":0.32200000000000001,"15min":0.32600000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17100000000000001},"max":{"1min":0.57899999999999996,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.34399999999999997,"15min":0.33300000000000002},"min":{"1min":0.20300000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.61299999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":0.79400000000000004,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":26.936,"5min":26.936,"15min":26.936},"last":0.629},{"interface":"front","average":{"1min":1.9330000000000001,"5min":0.69999999999999996,"15min":0.53800000000000003},"min":{"1min":0.26900000000000002,"5min":0.25,"15min":0.24199999999999999},"max":{"1min":26.763000000000002,"5min":26.763000000000002,"15min":26.763000000000002},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":3.9390000000000001,"5min":1.1679999999999999,"15min":0.65400000000000003},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":59.158999999999999,"5min":59.158999999999999,"15min":59.158999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":3.8490000000000002,"5min":1.151,"15min":0.67900000000000005},"min":{"1min":0.314,"5min":0.26400000000000001,"15min":0.26200000000000001},"max":{"1min":58.956000000000003,"5min":58.956000000000003,"15min":58.956000000000003},"last":0.27200000000000002}]},{"osd":5,"last update":"Sat Apr 20 02:24:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.71599999999999997,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":0.61599999999999999,"5min":23.010000000000002,"15min":23.010000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.755,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.29799999999999999,"15min":0.26200000000000001},"max":{"1min":0.64100000000000001,"5min":23.024000000000001,"15min":23.024000000000001},"last":0.29199999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266312,"kb_used_data":172928,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94105528,"statfs":{"total":96636764160,"available":96364060672,"internally_reserved":0,"allocated":177078272,"data_stored":2830619319,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30099999999999999,"15min":0.316},"min":{"1min":0.17000000000000001,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":0.46000000000000002,"5min":0.76300000000000001,"15min":1.526},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.18099999999999999,"5min":0.16400000000000001,"15min":0.14799999999999999},"max":{"1min":0.41499999999999998,"5min":0.81699999999999995,"15min":1.4239999999999999},"last":0.375}]},{"osd":2,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.21199999999999999,"5min":0.182,"15min":0.18099999999999999},"max":{"1min":0.875,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.53400000000000003,"5min":1.27,"15min":1.27},"last":0.30299999999999999}]},{"osd":3,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.69599999999999995,"15min":0.496},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":23.988,"15min":23.988},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.69499999999999995,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.68799999999999994,"5min":24.018999999999998,"15min":24.018999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.24099999999999999},"max":{"1min":0.58999999999999997,"5min":0.96699999999999997,"15min":1.28},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.49399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":1.2529999999999999,"15min":1.5580000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Apr 20 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46800000000000003,"15min":0.63400000000000001},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.76100000000000001,"15min":5.9530000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.93000000000000005,"15min":1.3280000000000001},"last":0.61399999999999999}]}]},{"osd":5,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272884,"kb_used_data":179500,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94098956,"statfs":{"total":96636764160,"available":96357330944,"internally_reserved":0,"allocated":183808000,"data_stored":2938164555,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.434,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.90700000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.8640000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.92900000000000005,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.89100000000000001,"5min":1.649,"15min":1.649},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.105,"5min":1.105,"15min":2.609},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51800000000000002,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":1.8979999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.80200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.19900000000000001},"max":{"1min":0.77300000000000002,"5min":38.515999999999998,"15min":38.515999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.747,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.67600000000000005,"5min":37.109999999999999,"15min":37.109999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":2.2589999999999999},"min":{"1min":0.28000000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.92700000000000005,"5min":0.93200000000000005,"15min":53.170000000000002},"last":0.503},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48899999999999999,"15min":2.2919999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.80600000000000005,"5min":0.91500000000000004,"15min":53.332000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":176910336,"data_stored":2830565376,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":120750080,"data_stored":1931935768,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89522176,"data_stored":1432354816,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131469312,"data_stored":2103443480,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158560256,"data_stored":2536964096,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183635968,"data_stored":2938109976,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:25:46.688 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T02:25:47.273 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:25:47.273 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":20,"fsid":"be7bb238-dfe1-4609-b2f6-7166cd58fb18","created":"2024-04-20T02:18:15.644958+0000","modified":"2024-04-20T02:18:36.881526+0000","last_up_change":"2024-04-20T02:18:24.839504+0000","last_in_change":"2024-04-20T02:18:17.670950+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-20T02:18:26.064735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"test","create_time":"2024-04-20T02:18:33.092921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44e25b4d-4524-4393-aaf6-ed675e351875","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":41897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6801","nonce":41897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6803","nonce":41897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":41897}]},"public_addr":"172.21.15.117:6800/41897","cluster_addr":"172.21.15.117:6801/41897","heartbeat_back_addr":"172.21.15.117:6803/41897","heartbeat_front_addr":"172.21.15.117:6802/41897","state":["exists","up"]},{"osd":1,"uuid":"cb83d083-1950-4842-b03e-a3fae5360ab1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":41898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6805","nonce":41898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6807","nonce":41898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":41898}]},"public_addr":"172.21.15.117:6804/41898","cluster_addr":"172.21.15.117:6805/41898","heartbeat_back_addr":"172.21.15.117:6807/41898","heartbeat_front_addr":"172.21.15.117:6806/41898","state":["exists","up"]},{"osd":2,"uuid":"46a99818-c29f-4d94-bbeb-615e88b1f888","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":41904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6809","nonce":41904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6811","nonce":41904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":41904}]},"public_addr":"172.21.15.117:6808/41904","cluster_addr":"172.21.15.117:6809/41904","heartbeat_back_addr":"172.21.15.117:6811/41904","heartbeat_front_addr":"172.21.15.117:6810/41904","state":["exists","up"]},{"osd":3,"uuid":"e6c137ef-18a4-4bb6-8850-3be95461e2ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6801","nonce":41361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6803","nonce":41361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6807","nonce":41361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6805","nonce":41361}]},"public_addr":"172.21.15.171:6801/41361","cluster_addr":"172.21.15.171:6803/41361","heartbeat_back_addr":"172.21.15.171:6807/41361","heartbeat_front_addr":"172.21.15.171:6805/41361","state":["exists","up"]},{"osd":4,"uuid":"0d0bee2c-aa82-41b0-8280-f0f320fa112f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":41362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":41362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":41362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":41362}]},"public_addr":"172.21.15.171:6800/41362","cluster_addr":"172.21.15.171:6802/41362","heartbeat_back_addr":"172.21.15.171:6806/41362","heartbeat_front_addr":"172.21.15.171:6804/41362","state":["exists","up"]},{"osd":5,"uuid":"1a0df0a9-7714-434f-a512-7fa7b7f14fd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":41363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6809","nonce":41363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6811","nonce":41363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":41363}]},"public_addr":"172.21.15.171:6808/41363","cluster_addr":"172.21.15.171:6809/41363","heartbeat_back_addr":"172.21.15.171:6811/41363","heartbeat_front_addr":"172.21.15.171:6810/41363","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.797612+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:23.891650+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.775004+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T02:18:22.807902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T02:25:48.291 INFO:tasks.ceph:Scrubbing osd.0 2024-04-20T02:25:48.292 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-20T02:25:48.449 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-20T02:25:48.450 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T02:25:48.450 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-20T02:25:48.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-20T02:25:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 0 to deep-scrub 2024-04-20T02:25:48.798 INFO:tasks.ceph:Scrubbing osd.1 2024-04-20T02:25:48.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-20T02:25:48.944 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-20T02:25:48.944 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T02:25:48.944 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-20T02:25:48.955 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-20T02:25:49.282 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 1 to deep-scrub 2024-04-20T02:25:49.293 INFO:tasks.ceph:Scrubbing osd.2 2024-04-20T02:25:49.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-20T02:25:49.437 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-20T02:25:49.437 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T02:25:49.438 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-20T02:25:49.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-20T02:25:49.775 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 2 to deep-scrub 2024-04-20T02:25:49.786 INFO:tasks.ceph:Scrubbing osd.3 2024-04-20T02:25:49.786 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-20T02:25:49.931 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-20T02:25:49.931 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T02:25:49.931 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-20T02:25:49.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-20T02:25:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 3 to deep-scrub 2024-04-20T02:25:50.283 INFO:tasks.ceph:Scrubbing osd.4 2024-04-20T02:25:50.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-20T02:25:50.429 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-20T02:25:50.429 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T02:25:50.430 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-20T02:25:50.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-20T02:25:50.771 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 4 to deep-scrub 2024-04-20T02:25:50.782 INFO:tasks.ceph:Scrubbing osd.5 2024-04-20T02:25:50.782 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-20T02:25:50.927 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-20T02:25:50.927 INFO:teuthology.orchestra.run.smithi117.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T02:25:50.927 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-20T02:25:50.939 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-20T02:25:51.270 INFO:teuthology.orchestra.run.smithi117.stderr:instructed osd(s) 5 to deep-scrub 2024-04-20T02:25:51.281 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:25:51.604 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:25:51.605 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:25:51.616 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-04-20T02:25:49.865466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1435768,"kb_used_data":841672,"kb_used_omap":9,"kb_used_meta":594038,"kb_avail":564795272,"statfs":{"total":579820584960,"available":578350358528,"internally_reserved":0,"allocated":861872128,"data_stored":13773699714,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":9562,"internal_metadata":608295590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18821,"num_read_kb":1204544,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":36700160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":35},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002960"},"pg_stats":[{"pgid":"2.f","version":"20'4224","reported_seq":314971,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518072+0000","last_change":"2024-04-20T02:18:35.888475+0000","last_active":"2024-04-20T02:25:36.518072+0000","last_peered":"2024-04-20T02:25:36.518072+0000","last_clean":"2024-04-20T02:25:36.518072+0000","last_became_active":"2024-04-20T02:18:35.888107+0000","last_became_peered":"2024-04-20T02:18:35.888107+0000","last_unstale":"2024-04-20T02:25:36.518072+0000","last_undegraded":"2024-04-20T02:25:36.518072+0000","last_fullsized":"2024-04-20T02:25:36.518072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":310730,"num_read_kb":19886720,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'4608","reported_seq":344063,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519824+0000","last_change":"2024-04-20T02:18:35.884054+0000","last_active":"2024-04-20T02:25:36.519824+0000","last_peered":"2024-04-20T02:25:36.519824+0000","last_clean":"2024-04-20T02:25:36.519824+0000","last_became_active":"2024-04-20T02:18:35.883711+0000","last_became_peered":"2024-04-20T02:18:35.883711+0000","last_unstale":"2024-04-20T02:25:36.519824+0000","last_undegraded":"2024-04-20T02:25:36.519824+0000","last_fullsized":"2024-04-20T02:25:36.519824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":339439,"num_read_kb":21724096,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5],"acting":[4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"20'4513","reported_seq":336286,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518500+0000","last_change":"2024-04-20T02:18:35.888648+0000","last_active":"2024-04-20T02:25:36.518500+0000","last_peered":"2024-04-20T02:25:36.518500+0000","last_clean":"2024-04-20T02:25:36.518500+0000","last_became_active":"2024-04-20T02:18:35.888273+0000","last_became_peered":"2024-04-20T02:18:35.888273+0000","last_unstale":"2024-04-20T02:25:36.518500+0000","last_undegraded":"2024-04-20T02:25:36.518500+0000","last_fullsized":"2024-04-20T02:25:36.518500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:56:38.265196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":331757,"num_read_kb":21232385,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'4544","reported_seq":337876,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519606+0000","last_change":"2024-04-20T02:18:35.882883+0000","last_active":"2024-04-20T02:25:36.519606+0000","last_peered":"2024-04-20T02:25:36.519606+0000","last_clean":"2024-04-20T02:25:36.519606+0000","last_became_active":"2024-04-20T02:18:35.882275+0000","last_became_peered":"2024-04-20T02:18:35.882275+0000","last_unstale":"2024-04-20T02:25:36.519606+0000","last_undegraded":"2024-04-20T02:25:36.519606+0000","last_fullsized":"2024-04-20T02:25:36.519606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":333316,"num_read_kb":21332224,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4176","reported_seq":312327,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517605+0000","last_change":"2024-04-20T02:18:35.888473+0000","last_active":"2024-04-20T02:25:36.517605+0000","last_peered":"2024-04-20T02:25:36.517605+0000","last_clean":"2024-04-20T02:25:36.517605+0000","last_became_active":"2024-04-20T02:18:35.888108+0000","last_became_peered":"2024-04-20T02:18:35.888108+0000","last_unstale":"2024-04-20T02:25:36.517605+0000","last_undegraded":"2024-04-20T02:25:36.517605+0000","last_fullsized":"2024-04-20T02:25:36.517605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":308134,"num_read_kb":19720576,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"20'4896","reported_seq":364823,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517619+0000","last_change":"2024-04-20T02:18:35.885811+0000","last_active":"2024-04-20T02:25:36.517619+0000","last_peered":"2024-04-20T02:25:36.517619+0000","last_clean":"2024-04-20T02:25:36.517619+0000","last_became_active":"2024-04-20T02:18:35.885319+0000","last_became_peered":"2024-04-20T02:18:35.885319+0000","last_unstale":"2024-04-20T02:25:36.517619+0000","last_undegraded":"2024-04-20T02:25:36.517619+0000","last_fullsized":"2024-04-20T02:25:36.517619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320864256,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":359911,"num_read_kb":23034304,"num_write":4896,"num_write_kb":313344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"20'4160","reported_seq":310345,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518887+0000","last_change":"2024-04-20T02:18:35.886262+0000","last_active":"2024-04-20T02:25:36.518887+0000","last_peered":"2024-04-20T02:25:36.518887+0000","last_clean":"2024-04-20T02:25:36.518887+0000","last_became_active":"2024-04-20T02:18:35.885835+0000","last_became_peered":"2024-04-20T02:18:35.885835+0000","last_unstale":"2024-04-20T02:25:36.518887+0000","last_undegraded":"2024-04-20T02:25:36.518887+0000","last_fullsized":"2024-04-20T02:25:36.518887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:25:40.617619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":306169,"num_read_kb":19594816,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"20'4544","reported_seq":339168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518874+0000","last_change":"2024-04-20T02:18:35.883682+0000","last_active":"2024-04-20T02:25:36.518874+0000","last_peered":"2024-04-20T02:25:36.518874+0000","last_clean":"2024-04-20T02:25:36.518874+0000","last_became_active":"2024-04-20T02:18:35.883256+0000","last_became_peered":"2024-04-20T02:18:35.883256+0000","last_unstale":"2024-04-20T02:25:36.518874+0000","last_undegraded":"2024-04-20T02:25:36.518874+0000","last_fullsized":"2024-04-20T02:25:36.518874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4544,"log_dups_size":0,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":334607,"num_read_kb":21414848,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.869585+0000","last_change":"2024-04-20T02:18:27.862673+0000","last_active":"2024-04-20T02:22:40.869585+0000","last_peered":"2024-04-20T02:22:40.869585+0000","last_clean":"2024-04-20T02:22:40.869585+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:22:40.869585+0000","last_undegraded":"2024-04-20T02:22:40.869585+0000","last_fullsized":"2024-04-20T02:22:40.869585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"20'4480","reported_seq":334202,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517104+0000","last_change":"2024-04-20T02:18:35.886165+0000","last_active":"2024-04-20T02:25:36.517104+0000","last_peered":"2024-04-20T02:25:36.517104+0000","last_clean":"2024-04-20T02:25:36.517104+0000","last_became_active":"2024-04-20T02:18:35.885771+0000","last_became_peered":"2024-04-20T02:18:35.885771+0000","last_unstale":"2024-04-20T02:25:36.517104+0000","last_undegraded":"2024-04-20T02:25:36.517104+0000","last_fullsized":"2024-04-20T02:25:36.517104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":0,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:37:40.379374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":329706,"num_read_kb":21101184,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914739+0000","last_change":"2024-04-20T02:18:27.861031+0000","last_active":"2024-04-20T02:22:40.914739+0000","last_peered":"2024-04-20T02:22:40.914739+0000","last_clean":"2024-04-20T02:22:40.914739+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:22:40.914739+0000","last_undegraded":"2024-04-20T02:22:40.914739+0000","last_fullsized":"2024-04-20T02:22:40.914739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:08.451384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4080","reported_seq":350627,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.523080+0000","last_change":"2024-04-20T02:25:36.523394+0000","last_active":"2024-04-20T02:25:36.523080+0000","last_peered":"2024-04-20T02:25:36.523080+0000","last_clean":"2024-04-20T02:25:36.523080+0000","last_became_active":"2024-04-20T02:18:35.885150+0000","last_became_peered":"2024-04-20T02:18:35.885150+0000","last_unstale":"2024-04-20T02:25:36.523080+0000","last_undegraded":"2024-04-20T02:25:36.523080+0000","last_fullsized":"2024-04-20T02:25:36.523080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:09:43.719561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":300256,"num_read_kb":19216384,"num_write":4080,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6642,"num_bytes_recovered":6964641792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6642},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:40.914552+0000","last_change":"2024-04-20T02:18:27.862623+0000","last_active":"2024-04-20T02:22:40.914552+0000","last_peered":"2024-04-20T02:22:40.914552+0000","last_clean":"2024-04-20T02:22:40.914552+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:22:40.914552+0000","last_undegraded":"2024-04-20T02:22:40.914552+0000","last_fullsized":"2024-04-20T02:22:40.914552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:04.276171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"20'4288","reported_seq":319188,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.515617+0000","last_change":"2024-04-20T02:18:35.883433+0000","last_active":"2024-04-20T02:25:36.515617+0000","last_peered":"2024-04-20T02:25:36.515617+0000","last_clean":"2024-04-20T02:25:36.515617+0000","last_became_active":"2024-04-20T02:18:35.883064+0000","last_became_peered":"2024-04-20T02:18:35.883064+0000","last_unstale":"2024-04-20T02:25:36.515617+0000","last_undegraded":"2024-04-20T02:25:36.515617+0000","last_fullsized":"2024-04-20T02:25:36.515617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:37:47.208411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":314884,"num_read_kb":20152576,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:24:43.916683+0000","last_change":"2024-04-20T02:18:27.861334+0000","last_active":"2024-04-20T02:24:43.916683+0000","last_peered":"2024-04-20T02:24:43.916683+0000","last_clean":"2024-04-20T02:24:43.916683+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:24:43.916683+0000","last_undegraded":"2024-04-20T02:24:43.916683+0000","last_fullsized":"2024-04-20T02:24:43.916683+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4608","reported_seq":343028,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.517528+0000","last_change":"2024-04-20T02:18:35.883390+0000","last_active":"2024-04-20T02:25:36.517528+0000","last_peered":"2024-04-20T02:25:36.517528+0000","last_clean":"2024-04-20T02:25:36.517528+0000","last_became_active":"2024-04-20T02:18:35.882708+0000","last_became_peered":"2024-04-20T02:18:35.882708+0000","last_unstale":"2024-04-20T02:25:36.517528+0000","last_undegraded":"2024-04-20T02:25:36.517528+0000","last_fullsized":"2024-04-20T02:25:36.517528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:55:36.974182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":338404,"num_read_kb":21657856,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:30.937109+0000","last_change":"2024-04-20T02:18:27.863608+0000","last_active":"2024-04-20T02:22:30.937109+0000","last_peered":"2024-04-20T02:22:30.937109+0000","last_clean":"2024-04-20T02:22:30.937109+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:22:30.937109+0000","last_undegraded":"2024-04-20T02:22:30.937109+0000","last_fullsized":"2024-04-20T02:22:30.937109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'4400","reported_seq":376717,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.528375+0000","last_change":"2024-04-20T02:25:36.528654+0000","last_active":"2024-04-20T02:25:36.528375+0000","last_peered":"2024-04-20T02:25:36.528375+0000","last_clean":"2024-04-20T02:25:36.528375+0000","last_became_active":"2024-04-20T02:18:35.882106+0000","last_became_peered":"2024-04-20T02:18:35.882106+0000","last_unstale":"2024-04-20T02:25:36.528375+0000","last_undegraded":"2024-04-20T02:25:36.528375+0000","last_fullsized":"2024-04-20T02:25:36.528375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:16:32.053379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288358400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":324042,"num_read_kb":20738688,"num_write":4400,"num_write_kb":281600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6933,"num_bytes_recovered":7269777408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6933},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:35.869220+0000","last_change":"2024-04-20T02:18:27.862322+0000","last_active":"2024-04-20T02:22:35.869220+0000","last_peered":"2024-04-20T02:22:35.869220+0000","last_clean":"2024-04-20T02:22:35.869220+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:22:35.869220+0000","last_undegraded":"2024-04-20T02:22:35.869220+0000","last_fullsized":"2024-04-20T02:22:35.869220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T07:21:54.583343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'3847","reported_seq":286508,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519617+0000","last_change":"2024-04-20T02:18:35.885452+0000","last_active":"2024-04-20T02:25:36.519617+0000","last_peered":"2024-04-20T02:25:36.519617+0000","last_clean":"2024-04-20T02:25:36.519617+0000","last_became_active":"2024-04-20T02:18:35.885067+0000","last_became_peered":"2024-04-20T02:18:35.885067+0000","last_unstale":"2024-04-20T02:25:36.519617+0000","last_undegraded":"2024-04-20T02:25:36.519617+0000","last_fullsized":"2024-04-20T02:25:36.519617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252116992,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":282644,"num_read_kb":18089216,"num_write":3847,"num_write_kb":246208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:45.939311+0000","last_change":"2024-04-20T02:18:27.862246+0000","last_active":"2024-04-20T02:22:45.939311+0000","last_peered":"2024-04-20T02:22:45.939311+0000","last_clean":"2024-04-20T02:22:45.939311+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:22:45.939311+0000","last_undegraded":"2024-04-20T02:22:45.939311+0000","last_fullsized":"2024-04-20T02:22:45.939311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:38.073183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"20'4240","reported_seq":363069,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519140+0000","last_change":"2024-04-20T02:25:36.495758+0000","last_active":"2024-04-20T02:25:36.519140+0000","last_peered":"2024-04-20T02:25:36.519140+0000","last_clean":"2024-04-20T02:25:36.519140+0000","last_became_active":"2024-04-20T02:18:35.882160+0000","last_became_peered":"2024-04-20T02:18:35.882160+0000","last_unstale":"2024-04-20T02:25:36.519140+0000","last_undegraded":"2024-04-20T02:25:36.519140+0000","last_fullsized":"2024-04-20T02:25:36.519140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:00:33.186890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":311427,"num_read_kb":19931328,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6800,"num_bytes_recovered":7130316800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6800},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:22:50.940161+0000","last_change":"2024-04-20T02:18:27.863872+0000","last_active":"2024-04-20T02:22:50.940161+0000","last_peered":"2024-04-20T02:22:50.940161+0000","last_clean":"2024-04-20T02:22:50.940161+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:22:50.940161+0000","last_undegraded":"2024-04-20T02:22:50.940161+0000","last_fullsized":"2024-04-20T02:22:50.940161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:26.845603+0000","last_clean_scrub_stamp":"2024-04-20T02:18:26.845603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:54.217138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'4448","reported_seq":332544,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.518174+0000","last_change":"2024-04-20T02:18:35.885082+0000","last_active":"2024-04-20T02:25:36.518174+0000","last_peered":"2024-04-20T02:25:36.518174+0000","last_clean":"2024-04-20T02:25:36.518174+0000","last_became_active":"2024-04-20T02:18:35.884739+0000","last_became_peered":"2024-04-20T02:18:35.884739+0000","last_unstale":"2024-04-20T02:25:36.518174+0000","last_undegraded":"2024-04-20T02:25:36.518174+0000","last_fullsized":"2024-04-20T02:25:36.518174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:21:42.919057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":328080,"num_read_kb":20997120,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":860848128,"data_stored":13773373512,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":0,"internal_metadata":0},"log_size":70056,"ondisk_log_size":70056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607644,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":236108,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94135732,"statfs":{"total":96636764160,"available":96394989568,"internally_reserved":0,"allocated":158732288,"data_stored":2537018675,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.71399999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.435,"15min":0.45700000000000002},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.54400000000000004,"5min":1.0760000000000001,"15min":1.6559999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.379},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"max":{"1min":0.79400000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.51300000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69199999999999995,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.41899999999999998},"min":{"1min":0.34300000000000003,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.69199999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.33800000000000002}]},{"osd":3,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.42699999999999999},"min":{"1min":0.249,"5min":0.245,"15min":0.218},"max":{"1min":0.64200000000000002,"5min":0.78000000000000003,"15min":1.5860000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.48799999999999999},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.223},"max":{"1min":0.73399999999999999,"5min":0.91700000000000004,"15min":2.4769999999999999},"last":0.379}]},{"osd":5,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46200000000000002,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":0.60299999999999998,"5min":0.82799999999999996,"15min":3.3849999999999998},"last":0.441},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.45900000000000002},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.24299999999999999},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":1.629},"last":0.45600000000000002}]}]},{"osd":3,"up_from":12,"seq":51539607645,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":213744,"kb_used_data":128552,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":94158096,"statfs":{"total":96636764160,"available":96417890304,"internally_reserved":0,"allocated":131637248,"data_stored":2103497423,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":1592,"internal_metadata":87226824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36799999999999999,"15min":0.40999999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.94699999999999995},"last":0.624},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.2929999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42599999999999999,"15min":0.51400000000000001},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.96699999999999997,"5min":1.3220000000000001,"15min":2.4209999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.502},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51700000000000002,"15min":0.69299999999999995},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0249999999999999,"5min":2.7410000000000001,"15min":5.3490000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.17299999999999999},"max":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.307},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.21099999999999999},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.89700000000000002},"last":0.35399999999999998}]},{"osd":5,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23000000000000001},"max":{"1min":0.66200000000000003,"5min":0.75800000000000001,"15min":2.2469999999999999},"last":0.38},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.745,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.371}]}]},{"osd":2,"up_from":12,"seq":51539607643,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144944,"kb_used_data":87592,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94226896,"statfs":{"total":96636764160,"available":96488341504,"internally_reserved":0,"allocated":89694208,"data_stored":1432409395,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.249},"min":{"1min":0.153,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":1.6830000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.34000000000000002,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.54400000000000004,"5min":1.6379999999999999,"15min":1.726},"last":0.378}]},{"osd":1,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":1.107,"5min":1.6379999999999999,"15min":2.0720000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17499999999999999},"max":{"1min":0.93999999999999995,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48699999999999999,"15min":0.379},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.20200000000000001},"max":{"1min":1.0409999999999999,"5min":1.569,"15min":1.569},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.39000000000000001},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65100000000000002,"5min":1.657,"15min":1.794},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.76},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.25900000000000001,"15min":0.25800000000000001},"max":{"1min":0.73299999999999998,"5min":1.5449999999999999,"15min":2.8580000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":1.673,"15min":1.8680000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.496}]}]},{"osd":1,"up_from":12,"seq":51539607644,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":118088,"kb_used_omap":1,"kb_used_meta":183678,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":120922112,"data_stored":1931990347,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":1594,"internal_metadata":188086726},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.40200000000000002},"min":{"1min":0.151,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":22.338999999999999,"5min":22.338999999999999,"15min":22.338999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":1.3799999999999999,"5min":0.72199999999999998,"15min":0.434},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.153},"max":{"1min":22.373000000000001,"5min":22.373000000000001,"15min":22.373000000000001},"last":0.44}]},{"osd":2,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33500000000000002,"15min":0.32800000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17100000000000001},"max":{"1min":1.506,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.19400000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.80400000000000005,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0209999999999999,"5min":26.936,"15min":26.936},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.72399999999999998,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":1.6339999999999999,"5min":26.763000000000002,"15min":26.763000000000002},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.173,"15min":0.65900000000000003},"min":{"1min":0.309,"5min":0.27200000000000002,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":59.158999999999999,"15min":59.158999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":1.1619999999999999,"15min":0.68200000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":58.956000000000003,"15min":58.956000000000003},"last":0.621}]},{"osd":5,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.73899999999999999,"15min":0.56100000000000005},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":1.601,"5min":23.010000000000002,"15min":23.010000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.443,"5min":0.752,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":23.024000000000001,"15min":23.024000000000001},"last":0.64800000000000002}]}]},{"osd":0,"up_from":11,"seq":47244640347,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266312,"kb_used_data":172928,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94105528,"statfs":{"total":96636764160,"available":96364060672,"internally_reserved":0,"allocated":177078272,"data_stored":2830619319,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30099999999999999,"15min":0.316},"min":{"1min":0.17000000000000001,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":0.46000000000000002,"5min":0.76300000000000001,"15min":1.526},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.18099999999999999,"5min":0.16400000000000001,"15min":0.14799999999999999},"max":{"1min":0.41499999999999998,"5min":0.81699999999999995,"15min":1.4239999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.21199999999999999,"5min":0.182,"15min":0.18099999999999999},"max":{"1min":0.875,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.53400000000000003,"5min":1.27,"15min":1.27},"last":0.375}]},{"osd":3,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.69599999999999995,"15min":0.496},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":23.988,"15min":23.988},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.69499999999999995,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.68799999999999994,"5min":24.018999999999998,"15min":24.018999999999998},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.24099999999999999},"max":{"1min":0.58999999999999997,"5min":0.96699999999999997,"15min":1.28},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.49399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":1.2529999999999999,"15min":1.5580000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Apr 20 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46800000000000003,"15min":0.63400000000000001},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.76100000000000001,"15min":5.9530000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.93000000000000005,"15min":1.3280000000000001},"last":0.66400000000000003}]}]},{"osd":5,"up_from":11,"seq":47244640348,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272884,"kb_used_data":179500,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94098956,"statfs":{"total":96636764160,"available":96357330944,"internally_reserved":0,"allocated":183808000,"data_stored":2938164555,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.434,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.90700000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.8640000000000001},"last":0.442}]},{"osd":1,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.92900000000000005,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.89100000000000001,"5min":1.649,"15min":1.649},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.105,"5min":1.105,"15min":2.609},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51800000000000002,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":1.8979999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.80200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.19900000000000001},"max":{"1min":0.77300000000000002,"5min":38.515999999999998,"15min":38.515999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.747,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.67600000000000005,"5min":37.109999999999999,"15min":37.109999999999999},"last":0.33600000000000002}]},{"osd":4,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":2.2589999999999999},"min":{"1min":0.28000000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.92700000000000005,"5min":0.93200000000000005,"15min":53.170000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48899999999999999,"15min":2.2919999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.80600000000000005,"5min":0.91500000000000004,"15min":53.332000000000001},"last":0.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":176910336,"data_stored":2830565376,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":120750080,"data_stored":1931935768,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89522176,"data_stored":1432354816,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131469312,"data_stored":2103443480,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158560256,"data_stored":2536964096,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183635968,"data_stored":2938109976,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:25:51.621 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.621 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.621 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.622 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.623 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.624 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-20T02:18:26.845603+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=26, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.624 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:25:51.624 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-20T02:26:11.625 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:26:11.956 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:26:11.957 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:26:11.968 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-20T02:26:11.869825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73896,"ondisk_log_size":73896,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1416952,"kb_used_data":841672,"kb_used_omap":9,"kb_used_meta":575222,"kb_avail":564814088,"statfs":{"total":579820584960,"available":578369626112,"internally_reserved":0,"allocated":861872128,"data_stored":13773699714,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":9562,"internal_metadata":589028006},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002330"},"pg_stats":[{"pgid":"2.f","version":"20'4488","reported_seq":315266,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:55.380276+0000","last_change":"2024-04-20T02:25:55.380394+0000","last_active":"2024-04-20T02:25:55.380276+0000","last_peered":"2024-04-20T02:25:55.380276+0000","last_clean":"2024-04-20T02:25:55.380276+0000","last_became_active":"2024-04-20T02:18:35.888107+0000","last_became_peered":"2024-04-20T02:18:35.888107+0000","last_unstale":"2024-04-20T02:25:55.380276+0000","last_undegraded":"2024-04-20T02:25:55.380276+0000","last_fullsized":"2024-04-20T02:25:55.380276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4488","last_scrub_stamp":"2024-04-20T02:25:55.380253+0000","last_deep_scrub":"20'4488","last_deep_scrub_stamp":"2024-04-20T02:25:55.380253+0000","last_clean_scrub_stamp":"2024-04-20T02:25:55.380253+0000","objects_scrubbed":264,"log_size":4488,"log_dups_size":0,"ondisk_log_size":4488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:36.278223+0000","scrub_duration":0.67512545400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":310730,"num_read_kb":19886720,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'4896","reported_seq":344385,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:05.211182+0000","last_change":"2024-04-20T02:26:05.211338+0000","last_active":"2024-04-20T02:26:05.211182+0000","last_peered":"2024-04-20T02:26:05.211182+0000","last_clean":"2024-04-20T02:26:05.211182+0000","last_became_active":"2024-04-20T02:18:35.883711+0000","last_became_peered":"2024-04-20T02:18:35.883711+0000","last_unstale":"2024-04-20T02:26:05.211182+0000","last_undegraded":"2024-04-20T02:26:05.211182+0000","last_fullsized":"2024-04-20T02:26:05.211182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4896","last_scrub_stamp":"2024-04-20T02:26:05.211140+0000","last_deep_scrub":"20'4896","last_deep_scrub_stamp":"2024-04-20T02:26:05.211140+0000","last_clean_scrub_stamp":"2024-04-20T02:26:05.211140+0000","objects_scrubbed":288,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:13:30.659221+0000","scrub_duration":0.86822468500000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":339439,"num_read_kb":21724096,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5],"acting":[4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"20'4796","reported_seq":336603,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:05.749893+0000","last_change":"2024-04-20T02:26:05.750019+0000","last_active":"2024-04-20T02:26:05.749893+0000","last_peered":"2024-04-20T02:26:05.749893+0000","last_clean":"2024-04-20T02:26:05.749893+0000","last_became_active":"2024-04-20T02:18:35.888273+0000","last_became_peered":"2024-04-20T02:18:35.888273+0000","last_unstale":"2024-04-20T02:26:05.749893+0000","last_undegraded":"2024-04-20T02:26:05.749893+0000","last_fullsized":"2024-04-20T02:26:05.749893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4796","last_scrub_stamp":"2024-04-20T02:26:05.749852+0000","last_deep_scrub":"20'4796","last_deep_scrub_stamp":"2024-04-20T02:26:05.749852+0000","last_clean_scrub_stamp":"2024-04-20T02:26:05.749852+0000","objects_scrubbed":283,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:46.647822+0000","scrub_duration":0.75521827100000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":331757,"num_read_kb":21232385,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'4828","reported_seq":338194,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:06.933907+0000","last_change":"2024-04-20T02:26:06.934001+0000","last_active":"2024-04-20T02:26:06.933907+0000","last_peered":"2024-04-20T02:26:06.933907+0000","last_clean":"2024-04-20T02:26:06.933907+0000","last_became_active":"2024-04-20T02:18:35.882275+0000","last_became_peered":"2024-04-20T02:18:35.882275+0000","last_unstale":"2024-04-20T02:26:06.933907+0000","last_undegraded":"2024-04-20T02:26:06.933907+0000","last_fullsized":"2024-04-20T02:26:06.933907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4828","last_scrub_stamp":"2024-04-20T02:26:06.933879+0000","last_deep_scrub":"20'4828","last_deep_scrub_stamp":"2024-04-20T02:26:06.933879+0000","last_clean_scrub_stamp":"2024-04-20T02:26:06.933879+0000","objects_scrubbed":284,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:47.831849+0000","scrub_duration":0.68888234100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":333316,"num_read_kb":21332224,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4437","reported_seq":312620,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:00.016675+0000","last_change":"2024-04-20T02:26:00.016836+0000","last_active":"2024-04-20T02:26:00.016675+0000","last_peered":"2024-04-20T02:26:00.016675+0000","last_clean":"2024-04-20T02:26:00.016675+0000","last_became_active":"2024-04-20T02:18:35.888108+0000","last_became_peered":"2024-04-20T02:18:35.888108+0000","last_unstale":"2024-04-20T02:26:00.016675+0000","last_undegraded":"2024-04-20T02:26:00.016675+0000","last_fullsized":"2024-04-20T02:26:00.016675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4437","last_scrub_stamp":"2024-04-20T02:26:00.016654+0000","last_deep_scrub":"20'4437","last_deep_scrub_stamp":"2024-04-20T02:26:00.016654+0000","last_clean_scrub_stamp":"2024-04-20T02:26:00.016654+0000","objects_scrubbed":261,"log_size":4437,"log_dups_size":0,"ondisk_log_size":4437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:58:18.941654+0000","scrub_duration":1.2130869790000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":308134,"num_read_kb":19720576,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"20'5202","reported_seq":365166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:01.022610+0000","last_change":"2024-04-20T02:26:01.022696+0000","last_active":"2024-04-20T02:26:01.022610+0000","last_peered":"2024-04-20T02:26:01.022610+0000","last_clean":"2024-04-20T02:26:01.022610+0000","last_became_active":"2024-04-20T02:18:35.885319+0000","last_became_peered":"2024-04-20T02:18:35.885319+0000","last_unstale":"2024-04-20T02:26:01.022610+0000","last_undegraded":"2024-04-20T02:26:01.022610+0000","last_fullsized":"2024-04-20T02:26:01.022610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'5202","last_scrub_stamp":"2024-04-20T02:26:01.022586+0000","last_deep_scrub":"20'5202","last_deep_scrub_stamp":"2024-04-20T02:26:01.022586+0000","last_clean_scrub_stamp":"2024-04-20T02:26:01.022586+0000","objects_scrubbed":306,"log_size":5202,"log_dups_size":0,"ondisk_log_size":5202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:19:31.606258+0000","scrub_duration":0.879844607,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320864256,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":359911,"num_read_kb":23034304,"num_write":4896,"num_write_kb":313344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"20'4160","reported_seq":310346,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519448+0000","last_change":"2024-04-20T02:18:35.886262+0000","last_active":"2024-04-20T02:25:36.519448+0000","last_peered":"2024-04-20T02:25:36.519448+0000","last_clean":"2024-04-20T02:25:36.519448+0000","last_became_active":"2024-04-20T02:18:35.885835+0000","last_became_peered":"2024-04-20T02:18:35.885835+0000","last_unstale":"2024-04-20T02:25:36.519448+0000","last_undegraded":"2024-04-20T02:25:36.519448+0000","last_fullsized":"2024-04-20T02:25:36.519448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":306169,"num_read_kb":19594816,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"20'4828","reported_seq":339485,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:02.514797+0000","last_change":"2024-04-20T02:26:02.514935+0000","last_active":"2024-04-20T02:26:02.514797+0000","last_peered":"2024-04-20T02:26:02.514797+0000","last_clean":"2024-04-20T02:26:02.514797+0000","last_became_active":"2024-04-20T02:18:35.883256+0000","last_became_peered":"2024-04-20T02:18:35.883256+0000","last_unstale":"2024-04-20T02:26:02.514797+0000","last_undegraded":"2024-04-20T02:26:02.514797+0000","last_fullsized":"2024-04-20T02:26:02.514797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4828","last_scrub_stamp":"2024-04-20T02:26:02.514774+0000","last_deep_scrub":"20'4828","last_deep_scrub_stamp":"2024-04-20T02:26:02.514774+0000","last_clean_scrub_stamp":"2024-04-20T02:26:02.514774+0000","objects_scrubbed":284,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:13:27.962855+0000","scrub_duration":0.72091924500000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":334607,"num_read_kb":21414848,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.984433+0000","last_change":"2024-04-20T02:25:51.984513+0000","last_active":"2024-04-20T02:25:51.984433+0000","last_peered":"2024-04-20T02:25:51.984433+0000","last_clean":"2024-04-20T02:25:51.984433+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:25:51.984433+0000","last_undegraded":"2024-04-20T02:25:51.984433+0000","last_fullsized":"2024-04-20T02:25:51.984433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.984412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.984412+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.984412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:58:49.874301+0000","scrub_duration":0.001496783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"20'4760","reported_seq":334516,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:02.023230+0000","last_change":"2024-04-20T02:26:02.023337+0000","last_active":"2024-04-20T02:26:02.023230+0000","last_peered":"2024-04-20T02:26:02.023230+0000","last_clean":"2024-04-20T02:26:02.023230+0000","last_became_active":"2024-04-20T02:18:35.885771+0000","last_became_peered":"2024-04-20T02:18:35.885771+0000","last_unstale":"2024-04-20T02:26:02.023230+0000","last_undegraded":"2024-04-20T02:26:02.023230+0000","last_fullsized":"2024-04-20T02:26:02.023230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4760","last_scrub_stamp":"2024-04-20T02:26:02.023207+0000","last_deep_scrub":"20'4760","last_deep_scrub_stamp":"2024-04-20T02:26:02.023207+0000","last_clean_scrub_stamp":"2024-04-20T02:26:02.023207+0000","objects_scrubbed":280,"log_size":4760,"log_dups_size":0,"ondisk_log_size":4760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:56:36.225297+0000","scrub_duration":0.73207432400000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":329706,"num_read_kb":21101184,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.176961+0000","last_change":"2024-04-20T02:25:51.177051+0000","last_active":"2024-04-20T02:25:51.176961+0000","last_peered":"2024-04-20T02:25:51.176961+0000","last_clean":"2024-04-20T02:25:51.176961+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:25:51.176961+0000","last_undegraded":"2024-04-20T02:25:51.176961+0000","last_fullsized":"2024-04-20T02:25:51.176961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.176929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.176929+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.176929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:14:20.817049+0000","scrub_duration":0.001540615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4335","reported_seq":350914,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:10.499500+0000","last_change":"2024-04-20T02:26:10.499592+0000","last_active":"2024-04-20T02:26:10.499500+0000","last_peered":"2024-04-20T02:26:10.499500+0000","last_clean":"2024-04-20T02:26:10.499500+0000","last_became_active":"2024-04-20T02:18:35.885150+0000","last_became_peered":"2024-04-20T02:18:35.885150+0000","last_unstale":"2024-04-20T02:26:10.499500+0000","last_undegraded":"2024-04-20T02:26:10.499500+0000","last_fullsized":"2024-04-20T02:26:10.499500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4335","last_scrub_stamp":"2024-04-20T02:26:10.499478+0000","last_deep_scrub":"20'4335","last_deep_scrub_stamp":"2024-04-20T02:26:10.499478+0000","last_clean_scrub_stamp":"2024-04-20T02:26:10.499478+0000","objects_scrubbed":255,"log_size":4335,"log_dups_size":0,"ondisk_log_size":4335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:50:36.075468+0000","scrub_duration":0.67914040099999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":300256,"num_read_kb":19216384,"num_write":4080,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6642,"num_bytes_recovered":6964641792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6642},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:57.201780+0000","last_change":"2024-04-20T02:25:57.201925+0000","last_active":"2024-04-20T02:25:57.201780+0000","last_peered":"2024-04-20T02:25:57.201780+0000","last_clean":"2024-04-20T02:25:57.201780+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:25:57.201780+0000","last_undegraded":"2024-04-20T02:25:57.201780+0000","last_fullsized":"2024-04-20T02:25:57.201780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:57.201756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:57.201756+0000","last_clean_scrub_stamp":"2024-04-20T02:25:57.201756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:38.099726+0000","scrub_duration":0.0019926929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"20'4556","reported_seq":319488,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:55.669348+0000","last_change":"2024-04-20T02:25:55.669443+0000","last_active":"2024-04-20T02:25:55.669348+0000","last_peered":"2024-04-20T02:25:55.669348+0000","last_clean":"2024-04-20T02:25:55.669348+0000","last_became_active":"2024-04-20T02:18:35.883064+0000","last_became_peered":"2024-04-20T02:18:35.883064+0000","last_unstale":"2024-04-20T02:25:55.669348+0000","last_undegraded":"2024-04-20T02:25:55.669348+0000","last_fullsized":"2024-04-20T02:25:55.669348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4556","last_scrub_stamp":"2024-04-20T02:25:55.669326+0000","last_deep_scrub":"20'4556","last_deep_scrub_stamp":"2024-04-20T02:25:55.669326+0000","last_clean_scrub_stamp":"2024-04-20T02:25:55.669326+0000","objects_scrubbed":268,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:49:57.153231+0000","scrub_duration":0.69697438099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":314884,"num_read_kb":20152576,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:49.754013+0000","last_change":"2024-04-20T02:25:49.754105+0000","last_active":"2024-04-20T02:25:49.754013+0000","last_peered":"2024-04-20T02:25:49.754013+0000","last_clean":"2024-04-20T02:25:49.754013+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:25:49.754013+0000","last_undegraded":"2024-04-20T02:25:49.754013+0000","last_fullsized":"2024-04-20T02:25:49.754013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:49.753981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:49.753981+0000","last_clean_scrub_stamp":"2024-04-20T02:25:49.753981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:19:20.337653+0000","scrub_duration":0.001728254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4857","reported_seq":343278,"reported_epoch":20,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-20T02:26:10.957664+0000","last_change":"2024-04-20T02:26:10.267172+0000","last_active":"2024-04-20T02:26:10.957664+0000","last_peered":"2024-04-20T02:26:10.957664+0000","last_clean":"2024-04-20T02:26:10.957664+0000","last_became_active":"2024-04-20T02:18:35.882708+0000","last_became_peered":"2024-04-20T02:18:35.882708+0000","last_unstale":"2024-04-20T02:26:10.957664+0000","last_undegraded":"2024-04-20T02:26:10.957664+0000","last_fullsized":"2024-04-20T02:26:10.957664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":249,"log_size":4857,"log_dups_size":0,"ondisk_log_size":4857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":338404,"num_read_kb":21657856,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:56.810250+0000","last_change":"2024-04-20T02:25:56.810364+0000","last_active":"2024-04-20T02:25:56.810250+0000","last_peered":"2024-04-20T02:25:56.810250+0000","last_clean":"2024-04-20T02:25:56.810250+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:25:56.810250+0000","last_undegraded":"2024-04-20T02:25:56.810250+0000","last_fullsized":"2024-04-20T02:25:56.810250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:56.810227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:56.810227+0000","last_clean_scrub_stamp":"2024-04-20T02:25:56.810227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:53:07.696775+0000","scrub_duration":0.0021460089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'4675","reported_seq":377026,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:00.026379+0000","last_change":"2024-04-20T02:26:00.026487+0000","last_active":"2024-04-20T02:26:00.026379+0000","last_peered":"2024-04-20T02:26:00.026379+0000","last_clean":"2024-04-20T02:26:00.026379+0000","last_became_active":"2024-04-20T02:18:35.882106+0000","last_became_peered":"2024-04-20T02:18:35.882106+0000","last_unstale":"2024-04-20T02:26:00.026379+0000","last_undegraded":"2024-04-20T02:26:00.026379+0000","last_fullsized":"2024-04-20T02:26:00.026379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4675","last_scrub_stamp":"2024-04-20T02:26:00.026341+0000","last_deep_scrub":"20'4675","last_deep_scrub_stamp":"2024-04-20T02:26:00.026341+0000","last_clean_scrub_stamp":"2024-04-20T02:26:00.026341+0000","objects_scrubbed":275,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:38.309838+0000","scrub_duration":1.2227637929999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288358400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":324042,"num_read_kb":20738688,"num_write":4400,"num_write_kb":281600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6933,"num_bytes_recovered":7269777408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6933},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.021509+0000","last_change":"2024-04-20T02:25:51.021600+0000","last_active":"2024-04-20T02:25:51.021509+0000","last_peered":"2024-04-20T02:25:51.021509+0000","last_clean":"2024-04-20T02:25:51.021509+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:25:51.021509+0000","last_undegraded":"2024-04-20T02:25:51.021509+0000","last_fullsized":"2024-04-20T02:25:51.021509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.021486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.021486+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.021486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:29.816860+0000","scrub_duration":0.001794747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'3847","reported_seq":286508,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:36.519617+0000","last_change":"2024-04-20T02:18:35.885452+0000","last_active":"2024-04-20T02:25:36.519617+0000","last_peered":"2024-04-20T02:25:36.519617+0000","last_clean":"2024-04-20T02:25:36.519617+0000","last_became_active":"2024-04-20T02:18:35.885067+0000","last_became_peered":"2024-04-20T02:18:35.885067+0000","last_unstale":"2024-04-20T02:25:36.519617+0000","last_undegraded":"2024-04-20T02:25:36.519617+0000","last_fullsized":"2024-04-20T02:25:36.519617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:18:33.869494+0000","last_clean_scrub_stamp":"2024-04-20T02:18:33.869494+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252116992,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":282644,"num_read_kb":18089216,"num_write":3847,"num_write_kb":246208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:54.833908+0000","last_change":"2024-04-20T02:25:54.834028+0000","last_active":"2024-04-20T02:25:54.833908+0000","last_peered":"2024-04-20T02:25:54.833908+0000","last_clean":"2024-04-20T02:25:54.833908+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:25:54.833908+0000","last_undegraded":"2024-04-20T02:25:54.833908+0000","last_fullsized":"2024-04-20T02:25:54.833908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:54.833884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:54.833884+0000","last_clean_scrub_stamp":"2024-04-20T02:25:54.833884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:54:13.372486+0000","scrub_duration":0.001290037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"20'4505","reported_seq":363366,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:00.711231+0000","last_change":"2024-04-20T02:26:00.711378+0000","last_active":"2024-04-20T02:26:00.711231+0000","last_peered":"2024-04-20T02:26:00.711231+0000","last_clean":"2024-04-20T02:26:00.711231+0000","last_became_active":"2024-04-20T02:18:35.882160+0000","last_became_peered":"2024-04-20T02:18:35.882160+0000","last_unstale":"2024-04-20T02:26:00.711231+0000","last_undegraded":"2024-04-20T02:26:00.711231+0000","last_fullsized":"2024-04-20T02:26:00.711231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4505","last_scrub_stamp":"2024-04-20T02:26:00.711190+0000","last_deep_scrub":"20'4505","last_deep_scrub_stamp":"2024-04-20T02:26:00.711190+0000","last_clean_scrub_stamp":"2024-04-20T02:26:00.711190+0000","objects_scrubbed":265,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:40:06.673004+0000","scrub_duration":0.82023049699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":311427,"num_read_kb":19931328,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6800,"num_bytes_recovered":7130316800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6800},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.955695+0000","last_change":"2024-04-20T02:25:51.955809+0000","last_active":"2024-04-20T02:25:51.955695+0000","last_peered":"2024-04-20T02:25:51.955695+0000","last_clean":"2024-04-20T02:25:51.955695+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:25:51.955695+0000","last_undegraded":"2024-04-20T02:25:51.955695+0000","last_fullsized":"2024-04-20T02:25:51.955695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.955674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.955674+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.955674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:16:04.290917+0000","scrub_duration":0.002050713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'4726","reported_seq":332856,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:59.969687+0000","last_change":"2024-04-20T02:25:59.969824+0000","last_active":"2024-04-20T02:25:59.969687+0000","last_peered":"2024-04-20T02:25:59.969687+0000","last_clean":"2024-04-20T02:25:59.969687+0000","last_became_active":"2024-04-20T02:18:35.884739+0000","last_became_peered":"2024-04-20T02:18:35.884739+0000","last_unstale":"2024-04-20T02:25:59.969687+0000","last_undegraded":"2024-04-20T02:25:59.969687+0000","last_fullsized":"2024-04-20T02:25:59.969687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4726","last_scrub_stamp":"2024-04-20T02:25:59.969645+0000","last_deep_scrub":"20'4726","last_deep_scrub_stamp":"2024-04-20T02:25:59.969645+0000","last_clean_scrub_stamp":"2024-04-20T02:25:59.969645+0000","objects_scrubbed":278,"log_size":4726,"log_dups_size":0,"ondisk_log_size":4726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:19:30.553317+0000","scrub_duration":1.000531136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":328080,"num_read_kb":20997120,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":860848128,"data_stored":13773373512,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":0,"internal_metadata":0},"log_size":73896,"ondisk_log_size":73896,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607649,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240204,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":94131636,"statfs":{"total":96636764160,"available":96390795264,"internally_reserved":0,"allocated":158732288,"data_stored":2537018675,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":1594,"internal_metadata":87226822},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.71399999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.63},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.435,"15min":0.45700000000000002},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.54400000000000004,"5min":1.0760000000000001,"15min":1.6559999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.379},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"max":{"1min":0.79400000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.51300000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69199999999999995,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.41899999999999998},"min":{"1min":0.34300000000000003,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.69199999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.42699999999999999},"min":{"1min":0.249,"5min":0.245,"15min":0.218},"max":{"1min":0.64200000000000002,"5min":0.78000000000000003,"15min":1.5860000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.48799999999999999},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.223},"max":{"1min":0.73399999999999999,"5min":0.91700000000000004,"15min":2.4769999999999999},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46200000000000002,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":0.60299999999999998,"5min":0.82799999999999996,"15min":3.3849999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.45900000000000002},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.24299999999999999},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":1.629},"last":0.44400000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607650,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217840,"kb_used_data":128552,"kb_used_omap":1,"kb_used_meta":89278,"kb_avail":94154000,"statfs":{"total":96636764160,"available":96413696000,"internally_reserved":0,"allocated":131637248,"data_stored":2103497423,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":1592,"internal_metadata":91421128},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36799999999999999,"15min":0.40999999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.94699999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.2929999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42599999999999999,"15min":0.51400000000000001},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.96699999999999997,"5min":1.3220000000000001,"15min":2.4209999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51700000000000002,"15min":0.69299999999999995},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0249999999999999,"5min":2.7410000000000001,"15min":5.3490000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.17299999999999999},"max":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.21099999999999999},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.89700000000000002},"last":0.36199999999999999}]},{"osd":5,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23000000000000001},"max":{"1min":0.66200000000000003,"5min":0.75800000000000001,"15min":2.2469999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.745,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.41899999999999998}]}]},{"osd":2,"up_from":12,"seq":51539607648,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132656,"kb_used_data":87592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94239184,"statfs":{"total":96636764160,"available":96500924416,"internally_reserved":0,"allocated":89694208,"data_stored":1432409395,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.249},"min":{"1min":0.153,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":1.6830000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.34000000000000002,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.54400000000000004,"5min":1.6379999999999999,"15min":1.726},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":1.107,"5min":1.6379999999999999,"15min":2.0720000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17499999999999999},"max":{"1min":0.93999999999999995,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.32700000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48699999999999999,"15min":0.379},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.20200000000000001},"max":{"1min":1.0409999999999999,"5min":1.569,"15min":1.569},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.39000000000000001},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65100000000000002,"5min":1.657,"15min":1.794},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.76},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.25900000000000001,"15min":0.25800000000000001},"max":{"1min":0.73299999999999998,"5min":1.5449999999999999,"15min":2.8580000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":1.673,"15min":1.8680000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.627}]}]},{"osd":1,"up_from":12,"seq":51539607649,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289488,"kb_used_data":118088,"kb_used_omap":1,"kb_used_meta":171390,"kb_avail":94082352,"statfs":{"total":96636764160,"available":96340328448,"internally_reserved":0,"allocated":120922112,"data_stored":1931990347,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":1594,"internal_metadata":175503814},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.40200000000000002},"min":{"1min":0.151,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":22.338999999999999,"5min":22.338999999999999,"15min":22.338999999999999},"last":0.214},{"interface":"front","average":{"1min":1.3799999999999999,"5min":0.72199999999999998,"15min":0.434},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.153},"max":{"1min":22.373000000000001,"5min":22.373000000000001,"15min":22.373000000000001},"last":0.23400000000000001}]},{"osd":2,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33500000000000002,"15min":0.32800000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17100000000000001},"max":{"1min":1.506,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.25},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.19400000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.26300000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.80400000000000005,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0209999999999999,"5min":26.936,"15min":26.936},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.72399999999999998,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":1.6339999999999999,"5min":26.763000000000002,"15min":26.763000000000002},"last":0.28100000000000003}]},{"osd":4,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.173,"15min":0.65900000000000003},"min":{"1min":0.309,"5min":0.27200000000000002,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":59.158999999999999,"15min":59.158999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":1.1619999999999999,"15min":0.68200000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":58.956000000000003,"15min":58.956000000000003},"last":0.30399999999999999}]},{"osd":5,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.73899999999999999,"15min":0.56100000000000005},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":1.601,"5min":23.010000000000002,"15min":23.010000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.752,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":23.024000000000001,"15min":23.024000000000001},"last":0.32600000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254024,"kb_used_data":172928,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94117816,"statfs":{"total":96636764160,"available":96376643584,"internally_reserved":0,"allocated":177078272,"data_stored":2830619319,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30099999999999999,"15min":0.316},"min":{"1min":0.17000000000000001,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":0.46000000000000002,"5min":0.76300000000000001,"15min":1.526},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.18099999999999999,"5min":0.16400000000000001,"15min":0.14799999999999999},"max":{"1min":0.41499999999999998,"5min":0.81699999999999995,"15min":1.4239999999999999},"last":0.223}]},{"osd":2,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.21199999999999999,"5min":0.182,"15min":0.18099999999999999},"max":{"1min":0.875,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.53400000000000003,"5min":1.27,"15min":1.27},"last":0.20699999999999999}]},{"osd":3,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.69599999999999995,"15min":0.496},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":23.988,"15min":23.988},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.69499999999999995,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.68799999999999994,"5min":24.018999999999998,"15min":24.018999999999998},"last":0.25600000000000001}]},{"osd":4,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.24099999999999999},"max":{"1min":0.58999999999999997,"5min":0.96699999999999997,"15min":1.28},"last":0.315},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.49399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":1.2529999999999999,"15min":1.5580000000000001},"last":0.26500000000000001}]},{"osd":5,"last update":"Sat Apr 20 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46800000000000003,"15min":0.63400000000000001},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.76100000000000001,"15min":5.9530000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.93000000000000005,"15min":1.3280000000000001},"last":0.29399999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640352,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282740,"kb_used_data":179500,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94089100,"statfs":{"total":96636764160,"available":96347238400,"internally_reserved":0,"allocated":183808000,"data_stored":2938164555,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.434,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.90700000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.8640000000000001},"last":0.621}]},{"osd":1,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.92900000000000005,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.89100000000000001,"5min":1.649,"15min":1.649},"last":0.66200000000000003}]},{"osd":2,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.105,"5min":1.105,"15min":2.609},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51800000000000002,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":1.8979999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.80200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.19900000000000001},"max":{"1min":0.77300000000000002,"5min":38.515999999999998,"15min":38.515999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.747,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.67600000000000005,"5min":37.109999999999999,"15min":37.109999999999999},"last":0.34799999999999998}]},{"osd":4,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":2.2589999999999999},"min":{"1min":0.28000000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.92700000000000005,"5min":0.93200000000000005,"15min":53.170000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48899999999999999,"15min":2.2919999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.80600000000000005,"5min":0.91500000000000004,"15min":53.332000000000001},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":176910336,"data_stored":2830565376,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":120750080,"data_stored":1931935768,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89522176,"data_stored":1432354816,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131469312,"data_stored":2103443480,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158560256,"data_stored":2536964096,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183635968,"data_stored":2938109976,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:26:11.971 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:26:11.971 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:26:11.971 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-20T02:18:33.869494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=18, tm_sec=33, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=2, tm_min=25, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T02:26:11.972 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-20T02:26:31.972 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T02:26:32.309 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-20T02:26:32.311 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-20T02:26:32.322 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-04-20T02:26:31.874509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74436,"ondisk_log_size":74436,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1425144,"kb_used_data":841672,"kb_used_omap":9,"kb_used_meta":583414,"kb_avail":564805896,"statfs":{"total":579820584960,"available":578361237504,"internally_reserved":0,"allocated":861872128,"data_stored":13773699714,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":9562,"internal_metadata":597416614},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003065"},"pg_stats":[{"pgid":"2.f","version":"20'4488","reported_seq":315266,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:55.380276+0000","last_change":"2024-04-20T02:25:55.380394+0000","last_active":"2024-04-20T02:25:55.380276+0000","last_peered":"2024-04-20T02:25:55.380276+0000","last_clean":"2024-04-20T02:25:55.380276+0000","last_became_active":"2024-04-20T02:18:35.888107+0000","last_became_peered":"2024-04-20T02:18:35.888107+0000","last_unstale":"2024-04-20T02:25:55.380276+0000","last_undegraded":"2024-04-20T02:25:55.380276+0000","last_fullsized":"2024-04-20T02:25:55.380276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4488","last_scrub_stamp":"2024-04-20T02:25:55.380253+0000","last_deep_scrub":"20'4488","last_deep_scrub_stamp":"2024-04-20T02:25:55.380253+0000","last_clean_scrub_stamp":"2024-04-20T02:25:55.380253+0000","objects_scrubbed":264,"log_size":4488,"log_dups_size":0,"ondisk_log_size":4488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:36.278223+0000","scrub_duration":0.67512545400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":310730,"num_read_kb":19886720,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"20'4896","reported_seq":344385,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:05.211182+0000","last_change":"2024-04-20T02:26:05.211338+0000","last_active":"2024-04-20T02:26:05.211182+0000","last_peered":"2024-04-20T02:26:05.211182+0000","last_clean":"2024-04-20T02:26:05.211182+0000","last_became_active":"2024-04-20T02:18:35.883711+0000","last_became_peered":"2024-04-20T02:18:35.883711+0000","last_unstale":"2024-04-20T02:26:05.211182+0000","last_undegraded":"2024-04-20T02:26:05.211182+0000","last_fullsized":"2024-04-20T02:26:05.211182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4896","last_scrub_stamp":"2024-04-20T02:26:05.211140+0000","last_deep_scrub":"20'4896","last_deep_scrub_stamp":"2024-04-20T02:26:05.211140+0000","last_clean_scrub_stamp":"2024-04-20T02:26:05.211140+0000","objects_scrubbed":288,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:13:30.659221+0000","scrub_duration":0.86822468500000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":339439,"num_read_kb":21724096,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5],"acting":[4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"20'4796","reported_seq":336603,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:05.749893+0000","last_change":"2024-04-20T02:26:05.750019+0000","last_active":"2024-04-20T02:26:05.749893+0000","last_peered":"2024-04-20T02:26:05.749893+0000","last_clean":"2024-04-20T02:26:05.749893+0000","last_became_active":"2024-04-20T02:18:35.888273+0000","last_became_peered":"2024-04-20T02:18:35.888273+0000","last_unstale":"2024-04-20T02:26:05.749893+0000","last_undegraded":"2024-04-20T02:26:05.749893+0000","last_fullsized":"2024-04-20T02:26:05.749893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4796","last_scrub_stamp":"2024-04-20T02:26:05.749852+0000","last_deep_scrub":"20'4796","last_deep_scrub_stamp":"2024-04-20T02:26:05.749852+0000","last_clean_scrub_stamp":"2024-04-20T02:26:05.749852+0000","objects_scrubbed":283,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:46.647822+0000","scrub_duration":0.75521827100000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":331757,"num_read_kb":21232385,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'4828","reported_seq":338194,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:06.933907+0000","last_change":"2024-04-20T02:26:06.934001+0000","last_active":"2024-04-20T02:26:06.933907+0000","last_peered":"2024-04-20T02:26:06.933907+0000","last_clean":"2024-04-20T02:26:06.933907+0000","last_became_active":"2024-04-20T02:18:35.882275+0000","last_became_peered":"2024-04-20T02:18:35.882275+0000","last_unstale":"2024-04-20T02:26:06.933907+0000","last_undegraded":"2024-04-20T02:26:06.933907+0000","last_fullsized":"2024-04-20T02:26:06.933907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4828","last_scrub_stamp":"2024-04-20T02:26:06.933879+0000","last_deep_scrub":"20'4828","last_deep_scrub_stamp":"2024-04-20T02:26:06.933879+0000","last_clean_scrub_stamp":"2024-04-20T02:26:06.933879+0000","objects_scrubbed":284,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:47.831849+0000","scrub_duration":0.68888234100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":333316,"num_read_kb":21332224,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4437","reported_seq":312620,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:00.016675+0000","last_change":"2024-04-20T02:26:00.016836+0000","last_active":"2024-04-20T02:26:00.016675+0000","last_peered":"2024-04-20T02:26:00.016675+0000","last_clean":"2024-04-20T02:26:00.016675+0000","last_became_active":"2024-04-20T02:18:35.888108+0000","last_became_peered":"2024-04-20T02:18:35.888108+0000","last_unstale":"2024-04-20T02:26:00.016675+0000","last_undegraded":"2024-04-20T02:26:00.016675+0000","last_fullsized":"2024-04-20T02:26:00.016675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4437","last_scrub_stamp":"2024-04-20T02:26:00.016654+0000","last_deep_scrub":"20'4437","last_deep_scrub_stamp":"2024-04-20T02:26:00.016654+0000","last_clean_scrub_stamp":"2024-04-20T02:26:00.016654+0000","objects_scrubbed":261,"log_size":4437,"log_dups_size":0,"ondisk_log_size":4437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:58:18.941654+0000","scrub_duration":1.2130869790000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":308134,"num_read_kb":19720576,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"20'5202","reported_seq":365166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:01.022610+0000","last_change":"2024-04-20T02:26:01.022696+0000","last_active":"2024-04-20T02:26:01.022610+0000","last_peered":"2024-04-20T02:26:01.022610+0000","last_clean":"2024-04-20T02:26:01.022610+0000","last_became_active":"2024-04-20T02:18:35.885319+0000","last_became_peered":"2024-04-20T02:18:35.885319+0000","last_unstale":"2024-04-20T02:26:01.022610+0000","last_undegraded":"2024-04-20T02:26:01.022610+0000","last_fullsized":"2024-04-20T02:26:01.022610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'5202","last_scrub_stamp":"2024-04-20T02:26:01.022586+0000","last_deep_scrub":"20'5202","last_deep_scrub_stamp":"2024-04-20T02:26:01.022586+0000","last_clean_scrub_stamp":"2024-04-20T02:26:01.022586+0000","objects_scrubbed":306,"log_size":5202,"log_dups_size":0,"ondisk_log_size":5202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:19:31.606258+0000","scrub_duration":0.879844607,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320864256,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":359911,"num_read_kb":23034304,"num_write":4896,"num_write_kb":313344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"20'4420","reported_seq":310637,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:13.908403+0000","last_change":"2024-04-20T02:26:13.908514+0000","last_active":"2024-04-20T02:26:13.908403+0000","last_peered":"2024-04-20T02:26:13.908403+0000","last_clean":"2024-04-20T02:26:13.908403+0000","last_became_active":"2024-04-20T02:18:35.885835+0000","last_became_peered":"2024-04-20T02:18:35.885835+0000","last_unstale":"2024-04-20T02:26:13.908403+0000","last_undegraded":"2024-04-20T02:26:13.908403+0000","last_fullsized":"2024-04-20T02:26:13.908403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4420","last_scrub_stamp":"2024-04-20T02:26:13.908379+0000","last_deep_scrub":"20'4420","last_deep_scrub_stamp":"2024-04-20T02:26:13.908379+0000","last_clean_scrub_stamp":"2024-04-20T02:26:13.908379+0000","objects_scrubbed":260,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T09:13:56.738789+0000","scrub_duration":0.61686285600000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":306169,"num_read_kb":19594816,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"20'4828","reported_seq":339485,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:02.514797+0000","last_change":"2024-04-20T02:26:02.514935+0000","last_active":"2024-04-20T02:26:02.514797+0000","last_peered":"2024-04-20T02:26:02.514797+0000","last_clean":"2024-04-20T02:26:02.514797+0000","last_became_active":"2024-04-20T02:18:35.883256+0000","last_became_peered":"2024-04-20T02:18:35.883256+0000","last_unstale":"2024-04-20T02:26:02.514797+0000","last_undegraded":"2024-04-20T02:26:02.514797+0000","last_fullsized":"2024-04-20T02:26:02.514797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4828","last_scrub_stamp":"2024-04-20T02:26:02.514774+0000","last_deep_scrub":"20'4828","last_deep_scrub_stamp":"2024-04-20T02:26:02.514774+0000","last_clean_scrub_stamp":"2024-04-20T02:26:02.514774+0000","objects_scrubbed":284,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:13:27.962855+0000","scrub_duration":0.72091924500000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":284,"num_whiteouts":0,"num_read":334607,"num_read_kb":21414848,"num_write":4544,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,5],"acting":[0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.984433+0000","last_change":"2024-04-20T02:25:51.984513+0000","last_active":"2024-04-20T02:25:51.984433+0000","last_peered":"2024-04-20T02:25:51.984433+0000","last_clean":"2024-04-20T02:25:51.984433+0000","last_became_active":"2024-04-20T02:18:27.862386+0000","last_became_peered":"2024-04-20T02:18:27.862386+0000","last_unstale":"2024-04-20T02:25:51.984433+0000","last_undegraded":"2024-04-20T02:25:51.984433+0000","last_fullsized":"2024-04-20T02:25:51.984433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.984412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.984412+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.984412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T06:58:49.874301+0000","scrub_duration":0.001496783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"20'4760","reported_seq":334516,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:02.023230+0000","last_change":"2024-04-20T02:26:02.023337+0000","last_active":"2024-04-20T02:26:02.023230+0000","last_peered":"2024-04-20T02:26:02.023230+0000","last_clean":"2024-04-20T02:26:02.023230+0000","last_became_active":"2024-04-20T02:18:35.885771+0000","last_became_peered":"2024-04-20T02:18:35.885771+0000","last_unstale":"2024-04-20T02:26:02.023230+0000","last_undegraded":"2024-04-20T02:26:02.023230+0000","last_fullsized":"2024-04-20T02:26:02.023230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4760","last_scrub_stamp":"2024-04-20T02:26:02.023207+0000","last_deep_scrub":"20'4760","last_deep_scrub_stamp":"2024-04-20T02:26:02.023207+0000","last_clean_scrub_stamp":"2024-04-20T02:26:02.023207+0000","objects_scrubbed":280,"log_size":4760,"log_dups_size":0,"ondisk_log_size":4760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T03:56:36.225297+0000","scrub_duration":0.73207432400000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":293601280,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":329706,"num_read_kb":21101184,"num_write":4480,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.176961+0000","last_change":"2024-04-20T02:25:51.177051+0000","last_active":"2024-04-20T02:25:51.176961+0000","last_peered":"2024-04-20T02:25:51.176961+0000","last_clean":"2024-04-20T02:25:51.176961+0000","last_became_active":"2024-04-20T02:18:27.860699+0000","last_became_peered":"2024-04-20T02:18:27.860699+0000","last_unstale":"2024-04-20T02:25:51.176961+0000","last_undegraded":"2024-04-20T02:25:51.176961+0000","last_fullsized":"2024-04-20T02:25:51.176961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.176929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.176929+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.176929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T05:14:20.817049+0000","scrub_duration":0.001540615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4335","reported_seq":350914,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:10.499500+0000","last_change":"2024-04-20T02:26:10.499592+0000","last_active":"2024-04-20T02:26:10.499500+0000","last_peered":"2024-04-20T02:26:10.499500+0000","last_clean":"2024-04-20T02:26:10.499500+0000","last_became_active":"2024-04-20T02:18:35.885150+0000","last_became_peered":"2024-04-20T02:18:35.885150+0000","last_unstale":"2024-04-20T02:26:10.499500+0000","last_undegraded":"2024-04-20T02:26:10.499500+0000","last_fullsized":"2024-04-20T02:26:10.499500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4335","last_scrub_stamp":"2024-04-20T02:26:10.499478+0000","last_deep_scrub":"20'4335","last_deep_scrub_stamp":"2024-04-20T02:26:10.499478+0000","last_clean_scrub_stamp":"2024-04-20T02:26:10.499478+0000","objects_scrubbed":255,"log_size":4335,"log_dups_size":0,"ondisk_log_size":4335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:50:36.075468+0000","scrub_duration":0.67914040099999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267386880,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":255,"num_whiteouts":0,"num_read":300256,"num_read_kb":19216384,"num_write":4080,"num_write_kb":261120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6642,"num_bytes_recovered":6964641792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6642},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:57.201780+0000","last_change":"2024-04-20T02:25:57.201925+0000","last_active":"2024-04-20T02:25:57.201780+0000","last_peered":"2024-04-20T02:25:57.201780+0000","last_clean":"2024-04-20T02:25:57.201780+0000","last_became_active":"2024-04-20T02:18:27.862294+0000","last_became_peered":"2024-04-20T02:18:27.862294+0000","last_unstale":"2024-04-20T02:25:57.201780+0000","last_undegraded":"2024-04-20T02:25:57.201780+0000","last_fullsized":"2024-04-20T02:25:57.201780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:57.201756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:57.201756+0000","last_clean_scrub_stamp":"2024-04-20T02:25:57.201756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:38.099726+0000","scrub_duration":0.0019926929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"20'4556","reported_seq":319488,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:55.669348+0000","last_change":"2024-04-20T02:25:55.669443+0000","last_active":"2024-04-20T02:25:55.669348+0000","last_peered":"2024-04-20T02:25:55.669348+0000","last_clean":"2024-04-20T02:25:55.669348+0000","last_became_active":"2024-04-20T02:18:35.883064+0000","last_became_peered":"2024-04-20T02:18:35.883064+0000","last_unstale":"2024-04-20T02:25:55.669348+0000","last_undegraded":"2024-04-20T02:25:55.669348+0000","last_fullsized":"2024-04-20T02:25:55.669348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4556","last_scrub_stamp":"2024-04-20T02:25:55.669326+0000","last_deep_scrub":"20'4556","last_deep_scrub_stamp":"2024-04-20T02:25:55.669326+0000","last_clean_scrub_stamp":"2024-04-20T02:25:55.669326+0000","objects_scrubbed":268,"log_size":4556,"log_dups_size":0,"ondisk_log_size":4556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:49:57.153231+0000","scrub_duration":0.69697438099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":314884,"num_read_kb":20152576,"num_write":4288,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:49.754013+0000","last_change":"2024-04-20T02:25:49.754105+0000","last_active":"2024-04-20T02:25:49.754013+0000","last_peered":"2024-04-20T02:25:49.754013+0000","last_clean":"2024-04-20T02:25:49.754013+0000","last_became_active":"2024-04-20T02:18:27.860999+0000","last_became_peered":"2024-04-20T02:18:27.860999+0000","last_unstale":"2024-04-20T02:25:49.754013+0000","last_undegraded":"2024-04-20T02:25:49.754013+0000","last_fullsized":"2024-04-20T02:25:49.754013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:49.753981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:49.753981+0000","last_clean_scrub_stamp":"2024-04-20T02:25:49.753981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:19:20.337653+0000","scrub_duration":0.001728254,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4896","reported_seq":343351,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:11.142229+0000","last_change":"2024-04-20T02:26:11.142358+0000","last_active":"2024-04-20T02:26:11.142229+0000","last_peered":"2024-04-20T02:26:11.142229+0000","last_clean":"2024-04-20T02:26:11.142229+0000","last_became_active":"2024-04-20T02:18:35.882708+0000","last_became_peered":"2024-04-20T02:18:35.882708+0000","last_unstale":"2024-04-20T02:26:11.142229+0000","last_undegraded":"2024-04-20T02:26:11.142229+0000","last_fullsized":"2024-04-20T02:26:11.142229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4896","last_scrub_stamp":"2024-04-20T02:26:11.142205+0000","last_deep_scrub":"20'4896","last_deep_scrub_stamp":"2024-04-20T02:26:11.142205+0000","last_clean_scrub_stamp":"2024-04-20T02:26:11.142205+0000","objects_scrubbed":288,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:58:30.067205+0000","scrub_duration":0.87490194099999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":338404,"num_read_kb":21657856,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4],"acting":[3,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:56.810364+0000","last_change":"2024-04-20T02:25:56.810364+0000","last_active":"2024-04-20T02:25:56.810364+0000","last_peered":"2024-04-20T02:25:56.810364+0000","last_clean":"2024-04-20T02:25:56.810364+0000","last_became_active":"2024-04-20T02:18:27.863359+0000","last_became_peered":"2024-04-20T02:18:27.863359+0000","last_unstale":"2024-04-20T02:25:56.810364+0000","last_undegraded":"2024-04-20T02:25:56.810364+0000","last_fullsized":"2024-04-20T02:25:56.810364+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:56.810227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:56.810227+0000","last_clean_scrub_stamp":"2024-04-20T02:25:56.810227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T02:53:07.696775+0000","scrub_duration":0.0021460089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'4675","reported_seq":377026,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:00.026379+0000","last_change":"2024-04-20T02:26:00.026487+0000","last_active":"2024-04-20T02:26:00.026379+0000","last_peered":"2024-04-20T02:26:00.026379+0000","last_clean":"2024-04-20T02:26:00.026379+0000","last_became_active":"2024-04-20T02:18:35.882106+0000","last_became_peered":"2024-04-20T02:18:35.882106+0000","last_unstale":"2024-04-20T02:26:00.026379+0000","last_undegraded":"2024-04-20T02:26:00.026379+0000","last_fullsized":"2024-04-20T02:26:00.026379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4675","last_scrub_stamp":"2024-04-20T02:26:00.026341+0000","last_deep_scrub":"20'4675","last_deep_scrub_stamp":"2024-04-20T02:26:00.026341+0000","last_clean_scrub_stamp":"2024-04-20T02:26:00.026341+0000","objects_scrubbed":275,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:38.309838+0000","scrub_duration":1.2227637929999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288358400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":324042,"num_read_kb":20738688,"num_write":4400,"num_write_kb":281600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6933,"num_bytes_recovered":7269777408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6933},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.021509+0000","last_change":"2024-04-20T02:25:51.021600+0000","last_active":"2024-04-20T02:25:51.021509+0000","last_peered":"2024-04-20T02:25:51.021509+0000","last_clean":"2024-04-20T02:25:51.021509+0000","last_became_active":"2024-04-20T02:18:27.861960+0000","last_became_peered":"2024-04-20T02:18:27.861960+0000","last_unstale":"2024-04-20T02:25:51.021509+0000","last_undegraded":"2024-04-20T02:25:51.021509+0000","last_fullsized":"2024-04-20T02:25:51.021509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.021486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.021486+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.021486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:29.816860+0000","scrub_duration":0.001794747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"20'4088","reported_seq":286778,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:11.508316+0000","last_change":"2024-04-20T02:26:11.508463+0000","last_active":"2024-04-20T02:26:11.508316+0000","last_peered":"2024-04-20T02:26:11.508316+0000","last_clean":"2024-04-20T02:26:11.508316+0000","last_became_active":"2024-04-20T02:18:35.885067+0000","last_became_peered":"2024-04-20T02:18:35.885067+0000","last_unstale":"2024-04-20T02:26:11.508316+0000","last_undegraded":"2024-04-20T02:26:11.508316+0000","last_fullsized":"2024-04-20T02:26:11.508316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4088","last_scrub_stamp":"2024-04-20T02:26:11.508273+0000","last_deep_scrub":"20'4088","last_deep_scrub_stamp":"2024-04-20T02:26:11.508273+0000","last_clean_scrub_stamp":"2024-04-20T02:26:11.508273+0000","objects_scrubbed":241,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:56:06.784529+0000","scrub_duration":0.56993716999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":252116992,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":0,"num_read":282644,"num_read_kb":18089216,"num_write":3847,"num_write_kb":246208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:54.833908+0000","last_change":"2024-04-20T02:25:54.834028+0000","last_active":"2024-04-20T02:25:54.833908+0000","last_peered":"2024-04-20T02:25:54.833908+0000","last_clean":"2024-04-20T02:25:54.833908+0000","last_became_active":"2024-04-20T02:18:27.861922+0000","last_became_peered":"2024-04-20T02:18:27.861922+0000","last_unstale":"2024-04-20T02:25:54.833908+0000","last_undegraded":"2024-04-20T02:25:54.833908+0000","last_fullsized":"2024-04-20T02:25:54.833908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:54.833884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:54.833884+0000","last_clean_scrub_stamp":"2024-04-20T02:25:54.833884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:54:13.372486+0000","scrub_duration":0.001290037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"20'4505","reported_seq":363366,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:26:00.711231+0000","last_change":"2024-04-20T02:26:00.711378+0000","last_active":"2024-04-20T02:26:00.711231+0000","last_peered":"2024-04-20T02:26:00.711231+0000","last_clean":"2024-04-20T02:26:00.711231+0000","last_became_active":"2024-04-20T02:18:35.882160+0000","last_became_peered":"2024-04-20T02:18:35.882160+0000","last_unstale":"2024-04-20T02:26:00.711231+0000","last_undegraded":"2024-04-20T02:26:00.711231+0000","last_fullsized":"2024-04-20T02:26:00.711231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4505","last_scrub_stamp":"2024-04-20T02:26:00.711190+0000","last_deep_scrub":"20'4505","last_deep_scrub_stamp":"2024-04-20T02:26:00.711190+0000","last_clean_scrub_stamp":"2024-04-20T02:26:00.711190+0000","objects_scrubbed":265,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T04:40:06.673004+0000","scrub_duration":0.82023049699999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":311427,"num_read_kb":19931328,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6800,"num_bytes_recovered":7130316800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6800},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:51.955695+0000","last_change":"2024-04-20T02:25:51.955809+0000","last_active":"2024-04-20T02:25:51.955695+0000","last_peered":"2024-04-20T02:25:51.955695+0000","last_clean":"2024-04-20T02:25:51.955695+0000","last_became_active":"2024-04-20T02:18:27.863649+0000","last_became_peered":"2024-04-20T02:18:27.863649+0000","last_unstale":"2024-04-20T02:25:51.955695+0000","last_undegraded":"2024-04-20T02:25:51.955695+0000","last_fullsized":"2024-04-20T02:25:51.955695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T02:25:51.955674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T02:25:51.955674+0000","last_clean_scrub_stamp":"2024-04-20T02:25:51.955674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T08:16:04.290917+0000","scrub_duration":0.002050713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"20'4726","reported_seq":332856,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T02:25:59.969687+0000","last_change":"2024-04-20T02:25:59.969824+0000","last_active":"2024-04-20T02:25:59.969687+0000","last_peered":"2024-04-20T02:25:59.969687+0000","last_clean":"2024-04-20T02:25:59.969687+0000","last_became_active":"2024-04-20T02:18:35.884739+0000","last_became_peered":"2024-04-20T02:18:35.884739+0000","last_unstale":"2024-04-20T02:25:59.969687+0000","last_undegraded":"2024-04-20T02:25:59.969687+0000","last_fullsized":"2024-04-20T02:25:59.969687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'4726","last_scrub_stamp":"2024-04-20T02:25:59.969645+0000","last_deep_scrub":"20'4726","last_deep_scrub_stamp":"2024-04-20T02:25:59.969645+0000","last_clean_scrub_stamp":"2024-04-20T02:25:59.969645+0000","objects_scrubbed":278,"log_size":4726,"log_dups_size":0,"ondisk_log_size":4726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:19:30.553317+0000","scrub_duration":1.000531136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":328080,"num_read_kb":20997120,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4591124504,"num_objects":4380,"num_object_clones":0,"num_object_copies":13140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4380,"num_whiteouts":0,"num_read":5153506,"num_read_kb":329824321,"num_write":70056,"num_write_kb":4483521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20375,"num_bytes_recovered":21364736000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":20375},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":860848128,"data_stored":13773373512,"data_compressed":11765910,"data_compressed_allocated":860835840,"data_compressed_original":13773373440,"omap_allocated":0,"internal_metadata":0},"log_size":74436,"ondisk_log_size":74436,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607653,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244300,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":89278,"kb_avail":94127540,"statfs":{"total":96636764160,"available":96386600960,"internally_reserved":0,"allocated":158732288,"data_stored":2537018675,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":1594,"internal_metadata":91421126},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.38900000000000001,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.71399999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.435,"15min":0.45700000000000002},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.54400000000000004,"5min":1.0760000000000001,"15min":1.6559999999999999},"last":0.435}]},{"osd":1,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.434,"15min":0.379},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22500000000000001},"max":{"1min":0.79400000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.47899999999999998,"15min":0.504},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.25800000000000001},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.376}]},{"osd":2,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.51300000000000001},"min":{"1min":0.252,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69199999999999995,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.49099999999999999,"15min":0.41899999999999998},"min":{"1min":0.34300000000000003,"5min":0.27600000000000002,"15min":0.26500000000000001},"max":{"1min":0.69199999999999995,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.47599999999999998}]},{"osd":3,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.42699999999999999},"min":{"1min":0.249,"5min":0.245,"15min":0.218},"max":{"1min":0.64200000000000002,"5min":0.78000000000000003,"15min":1.5860000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.45300000000000001,"15min":0.48799999999999999},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.223},"max":{"1min":0.73399999999999999,"5min":0.91700000000000004,"15min":2.4769999999999999},"last":0.34100000000000003}]},{"osd":5,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46200000000000002,"15min":0.53500000000000003},"min":{"1min":0.312,"5min":0.25900000000000001,"15min":0.21299999999999999},"max":{"1min":0.60299999999999998,"5min":0.82799999999999996,"15min":3.3849999999999998},"last":0.311},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.45900000000000002},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.24299999999999999},"max":{"1min":0.70899999999999996,"5min":0.81399999999999995,"15min":1.629},"last":0.45100000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607654,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217840,"kb_used_data":128552,"kb_used_omap":1,"kb_used_meta":89278,"kb_avail":94154000,"statfs":{"total":96636764160,"available":96413696000,"internally_reserved":0,"allocated":131637248,"data_stored":2103497423,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":1592,"internal_metadata":91421128},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36799999999999999,"15min":0.40999999999999998},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.94699999999999995},"last":0.5},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.2929999999999999},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42599999999999999,"15min":0.51400000000000001},"min":{"1min":0.254,"5min":0.224,"15min":0.224},"max":{"1min":0.96699999999999997,"5min":1.3220000000000001,"15min":2.4209999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.23899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51700000000000002,"15min":0.69299999999999995},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0249999999999999,"5min":2.7410000000000001,"15min":5.3490000000000002},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39100000000000001,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.17299999999999999},"max":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.80800000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.46400000000000002,"15min":0.434},"min":{"1min":0.26700000000000002,"5min":0.24099999999999999,"15min":0.21099999999999999},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.89700000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Sat Apr 20 02:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.441,"15min":0.46800000000000003},"min":{"1min":0.28000000000000003,"5min":0.24199999999999999,"15min":0.23000000000000001},"max":{"1min":0.66200000000000003,"5min":0.75800000000000001,"15min":2.2469999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.20899999999999999},"max":{"1min":0.745,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.44700000000000001}]}]},{"osd":2,"up_from":12,"seq":51539607652,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132656,"kb_used_data":87592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94239184,"statfs":{"total":96636764160,"available":96500924416,"internally_reserved":0,"allocated":89694208,"data_stored":1432409395,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.31900000000000001,"15min":0.249},"min":{"1min":0.153,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":1.6830000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.34000000000000002,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.54400000000000004,"5min":1.6379999999999999,"15min":1.726},"last":0.39100000000000001}]},{"osd":1,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.17899999999999999},"max":{"1min":1.107,"5min":1.6379999999999999,"15min":2.0720000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17499999999999999},"max":{"1min":0.93999999999999995,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48699999999999999,"15min":0.379},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.20200000000000001},"max":{"1min":1.0409999999999999,"5min":1.569,"15min":1.569},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42999999999999999,"15min":0.39000000000000001},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.65100000000000002,"5min":1.657,"15min":1.794},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.49299999999999999},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.76},"last":0.502},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46200000000000002,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.25900000000000001,"15min":0.25800000000000001},"max":{"1min":0.73299999999999998,"5min":1.5449999999999999,"15min":2.8580000000000001},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Apr 20 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49199999999999999,"15min":0.42999999999999999},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27600000000000002},"max":{"1min":0.67000000000000004,"5min":1.673,"15min":1.8680000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.45500000000000002}]}]},{"osd":1,"up_from":12,"seq":51539607653,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289488,"kb_used_data":118088,"kb_used_omap":1,"kb_used_meta":171390,"kb_avail":94082352,"statfs":{"total":96636764160,"available":96340328448,"internally_reserved":0,"allocated":120922112,"data_stored":1931990347,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":1594,"internal_metadata":175503814},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":20375,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.40200000000000002},"min":{"1min":0.151,"5min":0.14799999999999999,"15min":0.14099999999999999},"max":{"1min":22.338999999999999,"5min":22.338999999999999,"15min":22.338999999999999},"last":0.432},{"interface":"front","average":{"1min":1.3799999999999999,"5min":0.72199999999999998,"15min":0.434},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.153},"max":{"1min":22.373000000000001,"5min":22.373000000000001,"15min":22.373000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33500000000000002,"15min":0.32800000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17100000000000001},"max":{"1min":1.506,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.505},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.19400000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.42399999999999999,"5min":2.8919999999999999,"15min":2.8919999999999999},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.80400000000000005,"15min":0.52200000000000002},"min":{"1min":0.251,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0209999999999999,"5min":26.936,"15min":26.936},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.72399999999999998,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":1.6339999999999999,"5min":26.763000000000002,"15min":26.763000000000002},"last":0.64600000000000002}]},{"osd":4,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.173,"15min":0.65900000000000003},"min":{"1min":0.309,"5min":0.27200000000000002,"15min":0.246},"max":{"1min":0.74099999999999999,"5min":59.158999999999999,"15min":59.158999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":1.1619999999999999,"15min":0.68200000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.26200000000000001},"max":{"1min":0.74099999999999999,"5min":58.956000000000003,"15min":58.956000000000003},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Apr 20 02:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.73899999999999999,"15min":0.56100000000000005},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.26000000000000001},"max":{"1min":1.601,"5min":23.010000000000002,"15min":23.010000000000002},"last":0.624},{"interface":"front","average":{"1min":0.443,"5min":0.752,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":23.024000000000001,"15min":23.024000000000001},"last":0.746}]}]},{"osd":0,"up_from":11,"seq":47244640355,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258120,"kb_used_data":172928,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":94113720,"statfs":{"total":96636764160,"available":96372449280,"internally_reserved":0,"allocated":177078272,"data_stored":2830619319,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":1594,"internal_metadata":87226822},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30099999999999999,"15min":0.316},"min":{"1min":0.17000000000000001,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":0.46000000000000002,"5min":0.76300000000000001,"15min":1.526},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29999999999999999,"15min":0.29899999999999999},"min":{"1min":0.18099999999999999,"5min":0.16400000000000001,"15min":0.14799999999999999},"max":{"1min":0.41499999999999998,"5min":0.81699999999999995,"15min":1.4239999999999999},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.35099999999999998},"min":{"1min":0.21199999999999999,"5min":0.182,"15min":0.18099999999999999},"max":{"1min":0.875,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.372},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.53400000000000003,"5min":1.27,"15min":1.27},"last":0.35699999999999998}]},{"osd":3,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.69599999999999995,"15min":0.496},"min":{"1min":0.25600000000000001,"5min":0.252,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":23.988,"15min":23.988},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.69499999999999995,"15min":0.497},"min":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.23200000000000001},"max":{"1min":0.68799999999999994,"5min":24.018999999999998,"15min":24.018999999999998},"last":0.65600000000000003}]},{"osd":4,"last update":"Sat Apr 20 02:25:39 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.26400000000000001,"15min":0.24099999999999999},"max":{"1min":0.58999999999999997,"5min":0.96699999999999997,"15min":1.28},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53400000000000003,"15min":0.49399999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":1.2529999999999999,"15min":1.5580000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Apr 20 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46800000000000003,"15min":0.63400000000000001},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.22500000000000001},"max":{"1min":0.68999999999999995,"5min":0.76100000000000001,"15min":5.9530000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.26000000000000001,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.93000000000000005,"15min":1.3280000000000001},"last":0.63600000000000001}]}]},{"osd":5,"up_from":11,"seq":47244640356,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282740,"kb_used_data":179500,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94089100,"statfs":{"total":96636764160,"available":96347238400,"internally_reserved":0,"allocated":183808000,"data_stored":2938164555,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.434,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.90700000000000003,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39100000000000001,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.23699999999999999,"15min":0.20300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.8640000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.216,"15min":0.20799999999999999},"max":{"1min":0.92900000000000005,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.432},"min":{"1min":0.28799999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.89100000000000001,"5min":1.649,"15min":1.649},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.105,"5min":1.105,"15min":2.609},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51800000000000002,"15min":0.41799999999999998},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.25},"max":{"1min":1.8979999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.434}]},{"osd":3,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.80200000000000005,"15min":0.51300000000000001},"min":{"1min":0.22500000000000001,"5min":0.20799999999999999,"15min":0.19900000000000001},"max":{"1min":0.77300000000000002,"5min":38.515999999999998,"15min":38.515999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.747,"15min":0.48099999999999998},"min":{"1min":0.25700000000000001,"5min":0.22800000000000001,"15min":0.215},"max":{"1min":0.67600000000000005,"5min":37.109999999999999,"15min":37.109999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Sat Apr 20 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46800000000000003,"15min":2.2589999999999999},"min":{"1min":0.28000000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.92700000000000005,"5min":0.93200000000000005,"15min":53.170000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48899999999999999,"15min":2.2919999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.80600000000000005,"5min":0.91500000000000004,"15min":53.332000000000001},"last":0.33200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":176910336,"data_stored":2830565376,"data_compressed":2418050,"data_compressed_allocated":176910336,"data_compressed_original":2830565376,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":120750080,"data_stored":1931935768,"data_compressed":1650324,"data_compressed_allocated":120745984,"data_compressed_original":1931935744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89522176,"data_stored":1432354816,"data_compressed":1223608,"data_compressed_allocated":89522176,"data_compressed_original":1432354816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131469312,"data_stored":2103443480,"data_compressed":1796838,"data_compressed_allocated":131465216,"data_compressed_original":2103443456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158560256,"data_stored":2536964096,"data_compressed":2167188,"data_compressed_allocated":158560256,"data_compressed_original":2536964096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":183635968,"data_stored":2938109976,"data_compressed":2509902,"data_compressed_allocated":183631872,"data_compressed_original":2938109952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T02:26:32.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-20T02:26:32.668 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-20T02:26:32.668 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-20T02:26:32.668 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-20T02:26:32.668 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.721 INFO:tasks.ceph.osd.0:Stopped 2024-04-20T02:26:32.722 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-20T02:26:32.722 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.762 INFO:tasks.ceph.osd.1:Stopped 2024-04-20T02:26:32.763 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-20T02:26:32.763 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.828 INFO:tasks.ceph.osd.2:Stopped 2024-04-20T02:26:32.828 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-20T02:26:32.828 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.876 INFO:tasks.ceph.osd.3:Stopped 2024-04-20T02:26:32.876 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-20T02:26:32.876 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.921 INFO:tasks.ceph.osd.4:Stopped 2024-04-20T02:26:32.922 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-20T02:26:32.922 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.963 INFO:tasks.ceph.osd.5:Stopped 2024-04-20T02:26:32.963 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-20T02:26:32.963 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-20T02:26:32.963 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:32.987 INFO:tasks.ceph.mgr.x:Stopped 2024-04-20T02:26:32.987 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-20T02:26:32.987 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-20T02:26:32.987 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T02:26:33.038 INFO:tasks.ceph.mon.a:Stopped 2024-04-20T02:26:33.039 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-20T02:26:33.039 DEBUG:teuthology.orchestra.run.smithi117:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'missing primary copy of' | egrep -v 'objects unfound and apparently lost' | egrep -v 'had a read error' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(OSD_TOO_MANY_REPAIRS\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-04-20T02:26:33.153 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:26:33.153 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-20T02:26:33.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:26:33.277 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-20T02:26:33.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:26:33.371 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-20T02:26:33.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:26:33.502 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-20T02:26:34.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:26:34.267 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-20T02:26:34.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:26:34.375 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-20T02:26:34.453 INFO:tasks.ceph:Archiving mon data... 2024-04-20T02:26:34.454 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/data/mon.a.tgz 2024-04-20T02:26:34.454 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-04-20T02:26:34.476 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.UedNxIzDK3 2024-04-20T02:26:34.476 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UedNxIzDK3 2024-04-20T02:26:34.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.UedNxIzDK3 2024-04-20T02:26:34.931 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.UedNxIzDK3 is 1MB 2024-04-20T02:26:35.047 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.UedNxIzDK3 2024-04-20T02:26:35.064 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-20T02:26:35.064 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-20T02:26:35.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-20T02:26:35.138 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-20T02:26:35.139 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-20T02:26:35.174 DEBUG:teuthology.orchestra.run.smithi171:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-20T02:26:35.199 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-20T02:26:35.223 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-20T02:26:35.229 INFO:tasks.ceph:Archiving crash dumps... 2024-04-20T02:26:35.230 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/remote/smithi117/crash 2024-04-20T02:26:35.231 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-20T02:26:35.271 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/remote/smithi171/crash 2024-04-20T02:26:35.272 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-20T02:26:35.310 INFO:tasks.ceph:Compressing logs... 2024-04-20T02:26:35.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T02:26:35.317 DEBUG:teuthology.orchestra.run.smithi171:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T02:33:30.702 INFO:tasks.ceph:Archiving logs... 2024-04-20T02:33:30.704 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/remote/smithi117/log 2024-04-20T02:33:30.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T02:34:13.782 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/remote/smithi171/log 2024-04-20T02:34:13.784 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T02:34:52.174 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-20T02:34:52.186 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-20T02:34:52.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T02:34:52.190 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T02:34:52.313 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-20T02:34:52.322 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-20T02:34:52.323 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T02:34:52.325 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T02:34:52.341 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2024-04-20T02:34:52.343 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found 2024-04-20T02:34:52.383 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T02:34:52.384 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-04-20T02:34:52.384 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 -1168us[-1168us] +/- 73ms 2024-04-20T02:34:52.384 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -740us[ -637us] +/- 66ms 2024-04-20T02:34:52.384 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +1946us[+2050us] +/- 61ms 2024-04-20T02:34:52.384 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:34:52.405 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T02:34:52.405 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-04-20T02:34:52.405 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 -1102us[-1102us] +/- 73ms 2024-04-20T02:34:52.405 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -687us[ -696us] +/- 66ms 2024-04-20T02:34:52.405 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +2016us[+2016us] +/- 61ms 2024-04-20T02:34:52.405 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T02:34:52.406 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-20T02:34:52.415 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-20T02:34:52.416 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-20T02:34:52.425 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T02:34:52.569 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T02:34:52.675 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-20T02:34:52.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T02:34:52.708 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-20T02:34:52.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T02:34:52.740 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-20T02:34:52.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-20T02:34:52.766 INFO:teuthology.task.internal:Duration was 2132.693296 seconds 2024-04-20T02:34:52.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-20T02:34:52.775 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-20T02:34:52.775 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T02:34:52.778 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T02:34:52.867 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T02:34:52.874 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T02:34:53.315 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-20T02:34:53.315 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-04-20T02:34:53.315 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T02:34:53.340 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-04-20T02:34:53.340 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T02:34:53.376 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-20T02:34:53.376 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T02:34:53.382 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T02:34:53.461 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-20T02:34:53.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T02:34:53.464 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T02:34:53.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-20T02:34:53.578 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-20T02:34:53.579 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T02:34:53.639 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T02:34:53.697 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-20T02:34:53.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T02:34:53.709 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T02:34:53.754 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-04-20T02:34:53.776 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-04-20T02:34:53.797 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T02:34:53.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T02:34:53.814 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T02:34:53.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T02:34:53.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-20T02:34:53.841 INFO:teuthology.task.internal:Transferring archived files... 2024-04-20T02:34:53.842 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/remote/smithi117 2024-04-20T02:34:53.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T02:34:53.898 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-20_01:10:46-rados-wip-yuri7-testing-2024-04-18-1351-reef-distro-default-smithi/7664202/remote/smithi171 2024-04-20T02:34:53.898 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T02:34:53.938 INFO:teuthology.task.internal:Removing archive directory... 2024-04-20T02:34:53.938 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T02:34:53.941 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T02:34:53.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-20T02:34:54.000 INFO:teuthology.task.internal:Not uploading archives. 2024-04-20T02:34:54.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-20T02:34:54.010 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-20T02:34:54.010 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T02:34:54.012 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T02:34:54.031 INFO:teuthology.orchestra.run.smithi117.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 02:34 /home/ubuntu/cephtest 2024-04-20T02:34:54.048 INFO:teuthology.orchestra.run.smithi171.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 02:34 /home/ubuntu/cephtest 2024-04-20T02:34:54.049 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-20T02:34:54.060 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-20T02:34:54.091 INFO:teuthology.run:Summary data: description: rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} duration: 2132.693296432495 flavor: default owner: scheduled_yuriw@teuthology success: true 2024-04-20T02:34:54.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T02:34:54.169 INFO:teuthology.run:pass